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Method of Producing Color Conversion Table, Image Processing Device, 
Image Processing Method, Program and Recording Medium 

Technical Field 

The present invention relates to production of a color conversion 
table capable of enhancing continuity of color conversion of image data. 

Background Art 

A color reproducing device such as a scanner, a monitor, a printer, 
and a projector is different in a color reproduction characteristic due to 
difference in whether self-luminous or reflective, difference in tone 
representation, difference in primary colors to be used, and the like, and thus, 
even if the same RGB values, CMY values, or CMYK values are used, 
reproduced colors are largely different from one another. Therefore, to 
reproduce the same color on different color reproducing devices, it is 
necessary to represent a color in a device-independent space where a color is 
represented independently of characteristics of the devices, and to carry out 
so-called color management which determines actual ink quantities or 
monitor RGB values so that the colors are the same in the space. 

For example, as for a color printer, on the assumption that the RGB 
values of a scanner, a printer, a monitor, and the like are sRGB values, which 
is an international standard, Lab values are calculated according to the 
standard from the RGB values, and then, the Lab values are color-converted 
to a combination of inks for reproducing a color closest to the Lab values 
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among the colors reproducible by the printer. In general, this conversion is 
carried out at a predetermined grid interval in the RGB space, thereby 
producing a color conversion table (LUT), which carries out color conversion 
from RGB values to ink quantities in advance, and the color conversion table 
is installed in a printer driver or the like to reproduce desired colors. 

Generally, a color reproduction characteristic of a printer is 
determined by a characteristic of what combination of inks is used (referred 
to as "separation" hereinafter) for input RGB values. This separation is 
designed to satisfy various conditions, and thus, often causes discontinuous 
changes in the ink quantities. Therefore, there are always areas where the 
ink quantities discontinuously change on a color conversion table created by 
simply using this separation characteristic, resulting in tone jumps. If 
there exists the discontinuity in the lattice, a large error occurs in linear 
interpolation carried out for obtaining data between the lattice points, 
thereby also causing a twist in the color in this case. 

The present invention is devised to solve the above problems, and has 
a first object of providing a method of producing a color conversion table 
capable of restraining the color twists and the tone jumps in the output 
image as much as possible by correcting the discontinuities in the separation 
characteristic, and thus, enhancing the continuity of the color conversion 
table, and providing an image processing device, a method, a program, and a 
recording medium which use the color conversion table. 

If simple smoothing is applied to the table to solve the discontinuities 
in the lattice, the chroma may decrease across the entire table. 
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Further, the present invention is devised also to solve the above 
problem, and has a second object of providing a method of producing a color 
conversion table capable of restraining the color twists and the tone jumps as 
much as possible while maintaining the chroma, and providing an image 
processing device, an image processing method, a program, and a recording 
medium which use the color conversion table. 

Further, the present invention is devised to solve the above problem, 
and has a third object of providing a device, a method, and a program for 
producing a profile enabling color management among different color 
reproducing devices while restraining the color twists and the tone jumps of 
the output image as much as possible, and providing a recording medium for 
recording the program. 

Disclosure of Invention 

The present invention described in claim 1, is a method for producing 
a color conversion table by using a smoothing level evaluation function used 
for evaluating a smoothing level at respective lattice point data after color 
conversion by the color conversion table. 

The present invention described in claim 2, is an image processing 
device carrying out image processing using a color conversion table produced 
by using a smoothing level evaluation function used for evaluating a 
smoothing level at respective lattice point data after color conversion by the 
color conversion table. 
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The present invention described in claim 3, is the image processing 
device according to claim 2, wherein said smoothing level evaluation function 
includes an evaluation function based on a twisted quantity of an 
ink-quantity vector before and after the conversion using the color 
conversion table. 

In the above description, "a twisted quantity of an ink-quantity 
vector before and after the conversion using the color conversion table" 
implies a twisted quantity defined by the ink- quantity vectors between all 
grid points neighboring each other in an ink-quantity space represented by 
the ink quantities after the conversion corresponding to the respective grid 
points represented by input values (RGB) of the color conversion table. 

The present invention described in claim 4, is the image processing 
device according to claim 2 or 3, wherein said smoothing level evaluation 
function includes an evaluation function based on a twisted quantity in a 
virtual CMY space. 

In the above description, "a twisted quantity in a virtual CMY space" 
implies a twisted quantity defined by the three-dimensional vectors between 
all grid points neighboring each other in a space (virtual CMY space) 
three-dimensionalized by linear combination of an I-dimensional space (I is 
the number of inks) relating to the ink quantities. 

The present invention described in claim 5, is the image processing 
device according to any one of claims 2 through 4, wherein said twisted 
quantities are corrected both in said ink-quantity space and said 
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three- dim ensionalized virtual CMY space so as to correct the twisted 
quantities while maintaining continuity of the space before and after 
compression of the dimension. 

The present invention described in claim 6, is the image processing 
device according to any one of claims 2 through 5, wherein said smoothing 
level evaluation function includes an evaluation function based on a 
deviation level from a target ink quantity. 

The present invention described in claim 7, is the image processing 
device according to any one of claims 2 through 6, wherein said smoothing 
level evaluation function includes an evaluation function based on a 
deviation level from target virtual CMY. 

The present invention described in claim 8, is the image processing 
device according to any one of claims 2 through 7, wherein said smoothing 
level evaluation function includes an evaluation function based on an excess 
level from an ink quantity limitation. 

The present invention described in claim 9, is the image processing 
device according to any one of claims 2 through 8, wherein said smoothing 
level evaluation function includes an evaluation function based on an ink 
quantity reduced to minus. 

The present invention described in claim 10, is the image processing 
device according to any one of claims 2 through 9, wherein said smoothing 
level evaluation function includes an evaluation function based on ink 
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generation. 

In the above description, "an evaluation function based on ink 
generation" implies a function used for evaluating whether an ink is 
produced at a point where no ink quantity originally is present on the color 
conversion table before the smoothing. 

The present invention described in claim 11, is an image processing 
method for carrying out image processing using a color conversion table 
produced by using a smoothing level evaluation function used for evaluating 
a smoothing level at respective lattice point data after color conversion by 
the color conversion table. 

The present invention described in claim 12, is a program of 
instructions for execution by the computer to perform an image-processing 
using a color conversion table produced by using a smoothing level 
evaluation function used for evaluating a smoothing level at respective 
lattice point data after color conversion by the color conversion table. 

The present invention described in claim 13, is a method for 
producing a color conversion table by using a smoothing level evaluation 
function used for evaluating a smoothing level at respective lattice point 
data after color conversion by the color conversion table in a perceptually 
uniform color space such as the Lab space. 

The present invention described in claim 14, is an image processing 
device carrying out image processing using a color conversion table produced 
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by using a smoothing level evaluation function used for evaluating a 
smoothing level at respective lattice point data after color conversion by the 
color conversion table in a perceptually uniform color space such as the Lab 
space. 

The present invention described in claim 15, is the image processing 
device according to claim 14, wherein said smoothing level evaluation 
function includes an evaluation function based on a twisted quantity due to 
the perceptually uniform color space such as the Lab space before and after 
the color conversion using the color conversion table. 

The present invention described in claim 16, is the image processing 
device according to claim 14 or 15, wherein said smoothing level evaluation 
function includes an evaluation function based on a deviation level from the 
target perceptually uniform color space such as the Lab space. 

The present invention described in claim 17, is an image processing 
method carrying out image processing using a color conversion table 
produced by using a smoothing level evaluation function used for evaluating 
a smoothing level at respective lattice point data after color conversion by 
the color conversion table in a perceptually uniform color space such as the 
Lab space. 

The present invention described in claim 18, is a program of 
instructions for execution by the computer to perform an image-processing 
using a color conversion table produced by using a smoothing level 
evaluation function used for evaluating a smoothing level at respective 
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lattice point data after color conversion by the color conversion table in a 
perceptually uniform color space such as the Lab space. 

The present invention described in claim 19, is a method for 
producing a color conversion table by using a smoothing level evaluation 
function used for evaluating a smoothing level at respective lattice point 
data after color conversion by the color conversion table in a color space such 
as the CMY space. 

The present invention described in claim 20, is an image processing 
device carrying out image processing using a color conversion table produced 
by using a smoothing level evaluation function used for evaluating a 
smoothing level at respective lattice point data after color conversion by the 
color conversion table in a color space such as the CMY space. 

The present invention described in claim 21, is the image processing 
device according to claim 20, wherein said smoothing level evaluation 
function includes an evaluation function based on a twisted quantity due to 
the color space such as the CMY space before and after the color conversion 
using the color conversion table. 

The present invention described in claim 22, is the image processing 
device according to claim 20 or 21, wherein said smoothing level evaluation 
function includes an evaluation function based on a deviation level from 
target CMY values. 

The present invention described in claim 23, is the image processing 
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device according to any one of claims 20 through 22, wherein said smoothing 
level evaluation function includes an evaluation function preventing the 
CMY value from exceeding 255. 

The present invention described in claim 24, is the image processing 
device according to any one of claims 20 through 23, wherein said smoothing 
level evaluation function includes an evaluation function preventing the 
CMY value from being reduced to minus. 

The present invention described in claim 25, is an image processing 
method carrying out image processing using a color conversion table 
produced by using a smoothing level evaluation function used for evaluating 
a smoothing level at respective lattice point data after color conversion by 
the color conversion table in a color space such as the CMY space. 

The present invention described in claim 26, is a program of 
instructions for execution by the computer to perform an image-processing 
using a color conversion table produced by using a smoothing level 
evaluation function used for evaluating a smoothing level at respective 
lattice point data after color conversion by the color conversion table in a 
color space such as the CMY space. 

The present invention described in claim 27, is a method for 
producing a color conversion table by using a smoothing level evaluation 
function used for evaluating a smoothing level of color data at respective 
lattice points after color conversion by the color conversion table, and 
simultaneously, carrying out the color conversion such that the chroma 
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represented by the color data at the respective lattice points is maintained 
approximately constant before and after said smoothing. 

The present invention described in claim 28, is an image processing 
device carrying out image processing using a color conversion table produced 
by using a smoothing level evaluation function used for evaluating a 
smoothing level of color data at respective lattice points after color 
conversion by the color conversion table, and simultaneously, carrying out 
the color conversion such that the chroma represented by the color data at 
the respective lattice points is maintained approximately constant before 
and after said smoothing. 

The present invention described in claim 29, is the image processing 
device according to claim 28, wherein said color conversion table carries out 
the color conversion such that, as for such color data at the lattice point that 
the chroma represented by the color data decreases after said smoothing 
compared with the chroma represented by the color data before said 
smoothing, the chroma represented by the color data is maintained 
approximately constant before and after said smoothing. 

The present invention described in claim 30, is the image processing 
device according to claim 29, wherein said color conversion table carries out 
the color conversion such that, as for such color data at the lattice point that 
a ratio of the chroma represented by the color data after said smoothing to 
the maximum chroma determined by the hue and lightness represented by 
the color data after said smoothing decreases compared with a ratio of the 
chroma represented by the color data before said smoothing to the maximum 
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chroma determined by the hue and lightness represented by the color data 
after said smoothing, the chroma represented by the color data is maintained 
approximately constant before and after said smoothing. 

The present invention described in claim 31, is the image processing 
device according to claim 28 or 29, wherein said color conversion table carries 
out the color conversion such that, as for such color data as presenting the 
maximum chroma, the chroma represented by the color data is maintained 
approximately constant before and after said smoothing. 

The present invention described in claim 32, is the image processing 
device according to claim 28 or 29, wherein said color conversion table carries 
out the color conversion such that, as for such color data as not including at 
least one color of a plurality of element colors constituting the color data as a 
component color, the chroma represented by the color data is maintained 
approximately constant before and after said smoothing. 

The present invention described in claim 33, is the image processing 
device according to any one of claims 28 through 32, wherein said color 
conversion table carries out the color conversion such that a ratio of the 
chroma represented by the color data at the lattice point after said 
smoothing to the maximum chroma determined by the hue and lightness 
represented by the color data after said smoothing, and a ratio of the chroma 
represented by the color data before said smoothing to the maximum chroma 
determined by the hue and lightness represented by the color data after said 
smoothing are maintained approximately constant. 
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The present invention described in claim 34, is the image processing 
device according to any one of claims 28 through 33, wherein said smoothing 
level evaluation function includes an evaluation function based on a twisted 
quantity of an ink-quantity vector before and after the conversion using the 
color conversion table. 

The present invention described in claim 35, is the image processing 
device according to any one of claims 28 through 34, wherein said smoothing 
level evaluation function includes an evaluation function based on a twisted 
quantity in a virtual CMY space. 

The present invention described in claim 36, is the image processing 
device according to any one of claims 28 through 35, wherein said twisted 
quantities are corrected both in said ink-quantity space and said 
three-dimensionalized virtual CMY space so as to correct the twisted 
quantities while maintaining continuity of the space before and after 
compression of the dimension. 

The present invention described in claim 37, is the image processing 
device according to any one of claims 28 through 36, wherein said smoothing 
level evaluation function includes an evaluation function based on a 
deviation level from a target ink quantity. 

The present invention described in claim 38, is the image processing 
device according to any one of claims 28 through 37, wherein said smoothing 
level evaluation function includes an evaluation function based on a 
deviation level from target virtual CMY. 
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The present invention described in claim 39, is the image processing 
device according to claim 38, wherein said color conversion table carries out 
the color conversion such that the chroma represented by the color data is 
maintained approximately constant before and after said smoothing in said 
target virtual CMY. 

The present invention described in claim 40, is the image processing 
device according to any one of claims 28 through 39, wherein said smoothing 
level evaluation function includes an evaluation function based on an excess 
level from an ink quantity limitation. 

The present invention described in claim 41, is the image processing 
device according to any one of claims 28 through 40, wherein said smoothing 
level evaluation function includes an evaluation function based on an ink 
quantity reduced to minus. 

The present invention described in claim 42, is the image processing 
device according to any one of claims 28 through 41, wherein said smoothing 
level evaluation function includes an evaluation function based on ink 
generation. 

The present invention described in claim 43, is an image processing 
method carrying out image processing using a color conversion table 
produced by using a smoothing level evaluation function used for evaluating 
a smoothing level of color data at respective lattice points after color 
conversion by the color conversion table, and simultaneously, carrying out 
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the color conversion such that the chroma represented by the color data at 
the respective lattice points is maintained approximately constant before 
and after said smoothing. 

The present invention described in claim 44, is a program of 
instructions for execution by the computer to perform an image-processing 
using a color conversion table produced by using a smoothing level 
evaluation function used for evaluating a smoothing level of color data at 
respective lattice points after color conversion by the color conversion table, 
and simultaneously, carrying out the color conversion such that the chroma 
represented by the color data at the respective lattice points is maintained 
approximately constant before and after said smoothing. 

The present invention described in claim 45, is a profile producing 
device producing a profile by using a color chart output by an image output 
device comprising: a smoothed table producing means for producing a color 
conversion table smoothed by using a smoothing level evaluation function 
used for evaluating a smoothing level at respective lattice point data after 
color conversion by the color conversion table; a color chart producing means 
for causing the image output device to output the color chart based on 
desired image input data using the smoothed color conversion table produced 
by said smoothed table producing means; a colorimetry means for obtaining 
a colorimetry value of the color chart; and a profile producing means for 
producing a profile from a correspondence between said desired image input 
data and the colorimetry value corresponding to said image input data. 

The present invention described in claim 46, is the profile producing 
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device according to claim 45, wherein said desired image input data include a 
device value depending on a color reproduction characteristic of the image 
output device. 

The present invention described in claim 47, is the profile producing 
device according to claim 46, wherein the device value depending on the color 
reproduction characteristic of said image output device includes RGB values, 
CMY values, or CMYK values. 

The present invention described in claim 48, is the profile producing 
device according to any one of claims 45 through 47, wherein said 
colorimetry value is a colorimetry value indicating appearance of a color. 

The present invention described in claim 49, is the profile producing 
device according to claim 48, wherein said colorimetry value indicating the 
appearance of the color includes Lab values, Luv values, XYZ values, or CIE 
CAM 97S. 

The present invention described in claim 50, is the image processing 
device according to any one of claims 45 through 49, wherein said smoothing 
level evaluation function includes an evaluation function based on a twisted 
quantity of an ink-quantity vector before and after the conversion using the 
color conversion table. 

The present invention described in claim 51, is the image processing 
device according to any one of claims 45 through 50, wherein said smoothing 
level evaluation function includes an evaluation function based on a twisted 
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quantity in a virtual CMY space. 

The present invention described in claim 52, is the image processing 
device according to any one of claims 45 through 51, wherein said twisted 
quantities are corrected both in said ink-quantity space and said 
three dim ensionalized virtual CMY space so as to correct the twisted 
quantities while maintaining continuity of the space before and after 
compression of the dimension. 

The present invention described in claim 53, is the image processing 
device according to any one of claims 45 through 52, wherein said smoothing 
level evaluation function includes an evaluation function based on a 
deviation level from a target ink quantity. 

The present invention described in claim 54, is the image processing 
device according to any one of claims 45 through 53, wherein said smoothing 
level evaluation function includes an evaluation function based on a 
deviation level from target virtual CMY. 

The present invention described in claim 55, is the image processing 
device according to any one of claims 45 through 54, wherein said smoothing 
level evaluation function includes an evaluation function based on an excess 
level from an ink quantity limitation. 

The present invention described in claim 56, is the image processing 
device according to any one of claims 45 through 55, wherein said smoothing 
level evaluation function includes an evaluation function based on an ink 
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quantity reduced to minus. 

The present invention described in claim 57, is the image processing 
device according to any one of claims 45 through 56, wherein said smoothing 
level evaluation function includes an evaluation function based on ink 
generation. 

The present invention described in claim 58, is a profile producing 
method producing a profile by using a color chart output by an image output 
device comprising: a smoothed table producing step for producing a color 
conversion table smoothed by using a smoothing level evaluation function 
used for evaluating a smoothing level at respective lattice point data after 
color conversion by the color conversion table; a color chart producing step 
for causing the image output device to output the color chart based on 
desired image input data using the smoothed color conversion table produced 
by said smoothed table producing step; a colorimetry step for obtaining a 
colorimetry value of the color chart; and a profile producing step for 
producing a profile from a correspondence between said desired image input 
data and the colorimetry value corresponding to said image input data. 

The present invention described in claim 59, is a program of 
instructions for execution by the computer to perform a profile producing 
method producing a profile by using a color chart output by an image output 
device, said profile producing method comprising: a smoothed table 
producing step for producing a color conversion table smoothed by using a 
smoothing level evaluation function used for evaluating a smoothing level at 
respective lattice point data after color conversion by the color conversion 
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table; a color chart producing step for causing the image output device to 
output the color chart based on desired image input data using the smoothed 
color conversion table produced by said smoothed table producing step; a 
colorimetry step for obtaining a colorimetry value of the color chart; and a 
profile producing step for producing a profile from a correspondence between 
said desired image input data and the colorimetry value corresponding to 
said image input data. 

The present invention described in claim 60, is a recording medium 
readable by a computer recording a program according to any one of claims 
56, 18, 26, and 44. 

The present invention described in claim 61, is a method for 
producing a color conversion table using a plurality of costs used for 
evaluating a level of smoothing at respective lattice point data after color 
conversion using the color conversion table. 

Brief Description of Drawings 

Fig. 1 is a function block diagram of a color conversion table 
producing device according to an embodiment of the present invention; 

Fig. 2 is a block diagram for showing a constitution of the color 
conversion table producing device and the image processing apparatus 
according to the present invention; 

Fig. 3 is a function block diagram of an image processing device 
according to the embodiment of the present invention; 

Fig. 4 is a flowchart for explaining an operation of the image 
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processing device 20B; 

Fig. 5 is a flowchart describing the processing by the color conversion 
table producing device; 

Fig. 6 is a flowchart describing the smoothing processing by the color 
conversion table according to the first embodiment; 

Fig. 7 describes a definition of a twisted quantity vector of ink 
quantities according to the first embodiment; 

Fig. 8 is a function block diagram of an image processing apparatus 
according to an embodiment of the present invention; 

Fig. 9 is a flowchart describing the smoothing processing across the 
entire LUT by the color conversion table according to the second 
embodiment; 

Fig. 10 describes a definition of an Lab vector according to the second 
embodiment; 

Fig. 11 is a flowchart describing the smoothing processing across the 
entire LUT by the color conversion table according to the third embodiment; 

Fig. 12 describes a definition of CMY vectors according to the third 
embodiment; 

Fig. 13 is a drawing showing the grid point "p", the grid point "T" and 
the grid point in the virtual CMY space; 

Fig. 14 is a drawing showing the grid point "p", the grid point "T" and 
the grid point "T" in the virtual CMY space according to the first variation; 

Fig. 15 is a drawing showing the grid point "p", the grid point T and 
the grid point "T" in the virtual CMY space according to the third variation; 

Fig. 16 shows a function block diagram of a profile producing device 
20 according to an embodiment of the present invention; 

Fig. 17 shows a flowchart showing an operation of the profile 
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producing device 20 when the color conversion LUT is produced; 

Fig. 18 is a flowchart showing an operation of the profile producing 
device 20 when the ICC profile is produced; and 

Fig. 19 shows a function block diagram of an image processing device 
according to an embodiment of the present invention. 

Best Mode for Carrying Out the Invention 

A description will now be given of embodiments of the present 
invention with reference to drawings. It should be noted that a "color 
conversion table" implies a table (LUT) providing a function of converting 
input values (such as RGB values) to other values (such as CcMmYK values 
which are ink quantities) whether it carries out color correction or not in the 
present specification, and includes an LUT without color correction to which 
smoothing described below is applied. On the other hand, a "color 
correction table" is a table produced by a color management processing based 
on the input RGB values which are assumed to comply with conversion 
equation defined by international standard (such as the sRGB standard), 
and is a table (LUT) having a function of carrying out color correction such 
that a color shown when the input RGB values are represented on a display 
and a color shown when the input RGB values are represented in a printer 
output match each other. 

(A) First embodiment (production of color conversion table capable of 
enhancing continuity of color conversion of image data) 
(A- 1) First example 

Case using an evaluation function based on twisted quantities in ink 
quantities 
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Fig. 1 is a function block diagram of a color conversion table 
producing device according to an embodiment of the present invention, and 
Fig. 3 is a function block diagram of an image processing device according to 
the embodiment of the present invention. 

Hardware Constitution 

Fig. 2 is a schematic block diagram showing an example of a concrete 
hardware constitution of the color conversion table producing device and the 
image processing apparatus according to the present invention. 

The present embodiment employs a computer system as an example 
of hardware for the color conversion table producing device and the image 
processing apparatus. Fig. 2 shows the computer system as a block 
diagram. The computer system is provided with a scanner 11a, a digital 
still camera lib, and a video camera 11c as image input devices, and they are 
connected with a computer main unit 12. The individual input devices 
generate an image data where an image is represented by pixels arranged as 
dot matrix, and provide the computer main unit 12 with the image data, 
where the image data represents about 16,7 million colors by 256-gradation 
display in three primary colors including R, G, and B. 

A floppy disk drive 13a, a hard disk drive 13b, and a CD-ROM drive 
13c are connected with the computer main unit 12 as external auxiliary 
storage apparatuses, the hard disk 13b stores base programs relating to the 
system, and necessary programs are read from a floppy disk and a CD-ROM 
as required. A modem 14a is connected for connecting the computer main 
unit 12 with an external network or the like as a communication device, and 
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software and data are downloaded for introduction by connecting to the 
external network through a public communication line. In this example, 
though the modem 14a is used for the external access through the telephone 
line, a constitution for access to a network through a LAN adaptor is also 
possible. In addition, a keyboard 15a and a mouse 15b are connected for 
operating the computer main unit 12. 

The computer main unit 12 is provided with a display 17a, a color 
printer 17b and a projector 17c as image output devices. The display 17a is 
provides with a display area including 800 pixels in the horizontal direction 
and 600 pixels in the vertical direction, and 16,7 million colors are displayed 
on the individual pixels. This resolution is an example, and the resolution 
may be changed to 640 X 480 or 1024 X 768 as needed. 

The color printer 17b is an ink jet printer, and prints an image on a 
print sheet as a medium with color ink of four colors including C, M, Y, and K. 
As image resolution, high density print such as 360 X 360 dpi or 720 X 720 dpi 
is available, and as gradation representation, two-gradation representation 
by selecting whether attaching the color ink or not is available. A 
predetermined program is running on the computer main unit 12 to obtain 
an image through the image input devices, and to display or to provide on the 
image output device. An operating system (OS) 12a operates as a base 
program, and a display driver (DSP DRV) 12b for making the display 17a the 
displaying process, a printer driver (PRT DRV) 12c for making the color 
printer 17b the printing process and a projector driver 12d (not shown) for 
making the projector 17c the displaying process are integrated into the 
operating system 12a. The drivers 12b, 12c and 12d depend on the models 
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of the display 17a, the color printer 17b and the projector 17c and are added 
to or changed in the operating system 12a according to the models. It is also 
possible to realize a feature in addition to a standard processing depending 
on the models. In other words, different additional processes are realized in 
a permissible range while a common processing system is maintained on a 
standard system as the operating system 12a. 

As a prerequisite for running the program, the computer main unit 
12 is provided with a CPU 12e, a RAM 12f, a ROM 12g, an I/O 12h and the 
like, and the CPU 12e executes the base program written in the ROM 12g as 
needed while using the RAM 12f as a temporary work area or specified 
memory area, or a program area, and controls the external apparatuses 
connected through the I/O 12h and internal apparatuses. 

The application 12d is executed on the operating system 12a, which 
serves as the base program. Contents of the processing in application 12 d 
vary, and include monitoring the operation of keyboard 15a and the mouse 
15b as operating devices, properly controlling the different external 
apparatuses, executing corresponding calculation and the like when they are 
operated, and displaying or providing a processed result on the display 17a 
or the color printer 17b. 

The computer system obtains image data through the scanner 11a as 
an image input device, performs a predetermined image processing with the 
application 12d, and show the processed result as output on the display 17a, 
the color printer 17b or the projector 17c, which serve as image output 
devices. 
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In the present invention, though the image processing apparatus is 
realized as a computer system, the computer system is not necessarily 
required, and a system that applies the process required in the present 
invention to similar image data is possible. A system where an image 
processing system for performing the image processing of present invention 
is integrated in a digital still camera, and image data after the image 
processing are used for printing through a color printer is possible. For a 
color printer, which obtains image data and prints without a computer 
system, it is possible to constitute such that the image processing of present 
invention is automatically applied on image data obtained through a scanner, 
a digital still camera, modem or the like and printing is processed. 

The present invention is naturally applicable to different 
apparatuses for handling image data such as a color facsimile apparatus, a 
color copy apparatus or a projector as well. 

Image-processing control program 

An image-processing control program according to the present 
invention is usually recorded in a form readable by the computer 12 on a 
recording medium such as a floppy disk and a CD-ROM for circulation. The 
program is read by a medium reading device (such as the CD-ROM drive 13c 
and the floppy disk drive 13a), and is installed on the hard disk 13b. The 
program is constituted such that the CPU then properly reads a desired 
program from the hard disk 13b so as to carry out desired processing. Note 
that the image-processing control program itself according to the present 
invention constitutes a part of the present applied invention. 
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Color conversion table producing device 

The color conversion table producing device 20A shown in Fig. 1 
produces a color conversion table capable of enhancing continuity of color 
conversion of image data when CMY image data are converted to CMYKcm 
image data. It should be noted that C denotes cyan; M, magenta; Y, yellow; 
K, black; c, light cyan; and m, light magenta. 

In Fig. 1, the color conversion table producing device 20A is 
comprised of a cost calculating unit 20d, a color conversion table (LUT) 
smoothing unit 20e, a color conversion table (LUT) producing unit 20f, and a 
color conversion table (LUT) storing unit 20b. A detailed description will be 
given of processing in these respective components later. 

A description will now be given of a color conversion table producing 
program executed by the color conversion table producing device 20A shown 
in Fig. 1 with reference to Figs. 5 through 7. 

Fig. 5 shows a flowchart describing the processing by the color 
conversion table producing device which converts CMY image data to 
CMYKcm image data. 

Calculation of respective costs (step S22) 

As Fig. 5 shows, first, the cost calculating unit 20d of the color 
conversion table producing device 20A calculates respective costs in a 
function (referred to as "evaluation function" hereinafter) E for evaluating a 
level of smoothing of data at respective lattice points (grid points) after the 



25 



FEP0208PCT 



PCT/JP03/00110 



color conversion using the color conversion table (step S22). A detailed 
description will now be given of the evaluation function E. 

(A-l-l) The evaluation function E is designed so as to have a smaller value if 
respective conditions are satisfied for a certain grid point on the LUT. For 
example, smoothing is applied to the ink quantities, the evaluation function 
is represented as a sum of cost terms designed based on the respective 
conditions- 

E =Eit+Evt+Es+Ev + Ed + En + EobH — (A-l-l) 
where- 

Eit is a cost due to a twisted quantity of an ink-quantity vector, 
Evt is a cost due to a twisted quantity in a virtual CMY space, 
E s is a cost due to a deviation from target ink quantities, 
E v is a cost due to a deviation from target virtual CMY, 
Ed is a cost due to violation of an ink quantity limitation, 
En is a cost due to an ink quantity reduced to minus, and 
Eob is a cost relating to ink generation. 

Eu and Evt are costs relating to a twist between grid points 
neighboring each other, and it is possible to enhance continuity of image data 
after the color conversion by reducing these costs, thereby reducing the twist 
between the neighboring grid points caused by the conversion from CMY to 
CMYKcm. E s and E v are costs produced by differences between the 
ink-quantity vector before and after the smoothing, and related to a vector 
difference of the ink quantities caused by a chronological change at the same 
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grid points. Ed, E n , and E Q b are costs of restraining excesses from the 
predetermined limitations. 

A detailed description will now be given of the respective terms. It 
should be noted that it is not necessary to use all of the terms, and it is 
possible to select terms to be used if necessary. The equation (A-l-l) shows 
an example of smoothing the ink-quantity vector, and application to other 
vectors (vectors in Lab, XYZ, CMY, and other spaces) may be carried out in 
the same manner. 

(A"l"2) General forms of respective terms of evaluation function E 

A cost term E c of the evaluation function relating to a certain vector X 
is represented by the following equation- 



where: 

E c is a cost (scalar), 

X is a column vector having X of elements, 

M is a Y x X matrix used for converting the vector X to a vector Y=M-X, 
which is a vector having Y of elements subject to the cost, 
Yt is a column vector having Y of elements, 

Wi is a column vector having Y of elements, and represents weights for the 




'Wi -(m-x 



Yt) 



• • • (A- 1-2) 
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cost assigned to the respective elements of a vector Y-Yt, 

W2 is a Y x Y diagonal matrix, and represents weights for the cost assigned 

to the respective elements of the vector Y-Yt, and 

"t" denotes transposition. 

In the following description, a first equation and a second equation of 
the equation (A- 1-2) are respectively referred to as a linear equation form 
and a quadratic equation form. 

(A- 1-3) Cost Eit due to twisted quantity of ink- quantity vector (ink-quantity 
vector space) 

A grid point neighboring a certain grid point "p" is denoted as p r 
(referred to as "reference grid point" hereinafter). A grid point other than 
the grid point p r neighboring the grid point "p" is denoted as p t (referred to as 
"transition grid point" hereinafter), and a grid point which has the same 
positional relationship with the grid point pt as that the grid point "p" has 
with the grid point p r is denoted as p tr . It is assumed that the respective 
grid points "p", p r , pt, and ptr retain ink-quantity vectors I p , I pr , I P t, and I pt r. 

Fig. 7 shows a positional relationship of these grid points and the 
ink-quantity vectors retained by these grid points. In Fig. 7, if it is 
considered that a difference vector between I pr and I p is transitioned to a 
difference vector between I p tr and I p t, a "displacement of the difference vector 
before and after the transition" is represented as a difference vector between 
these difference vectors. In addition, if a transition distance is considered 
as the magnitude of the difference vector between I pt and I p , a "displacement 
of the difference vector before and after the transition per unit transition 
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distance" is obtained by dividing the "displacement of the difference vector 
before and after the transition" by the transition distance. The twisted 
quantity of the ink-quantity vector at the grid point "p" is defined by adding 
the square of the magnitude of the "displacement of the difference vector 
before and after the transition per unit transition distance" for all of the grid 
points p r and pt neighboring the grid point "p". It should be noted that p r 
and pt may be the same grid point as long as they are neighboring "p". 

This twisted quantity of the ink-quantity vector is represented as a 
cost in an equation (A- 1-3)- 



Eu 



R 



■ii 



Ip + Iptr — Ipr — I 



Lpt 



Dt 



(A- 1-3) 



In the equation (A- 1-3), 

"t" denotes a certain p t , 

T denotes the number of pt, 

V denotes a certain p r , 

R denotes the number of p r , and 

Dt denotes a transition distance at "t". 

The smaller the cost Eit becomes, the more the twisted quantity of the 
ink quantities can be reduced. 
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Comparison of the equation (A- 1-3) to the second equation of the 
equation (A- 1-2) reveals that it is not necessary to convert the ink-quantity 
vector to a vector in other space, and thus, M is represented as a unit vector, 
and can be omitted. The respective elements are not multiplied by the 
weights, and thus, the W2 is also a unit vector, and can be omitted. X 
corresponds to I p , and Yt corresponds to Iptr Ipr Ipt. 1/Dt 2 is a constant for a 
certain "t", and thus, the equation (A- 1-3) have the same form as the second 
equation of the equation (A- 1-2). 

(A- 1*4) Cost Evt due to twisted quantity in virtual CMY space 

The conversion to the ink quantities are generally carried out from a 
three dimensional space such as the RGB or CMY space, and thus, if the 
twists are corrected only in the ink-quantity space, the conversion 
relationship between the original three-dimensional space such as the RGB 
or CMY space and the ink-quantity space having I dimensions may become 
non-linear. To minimize this collapse, it is considered that a preferable 
result is attained by simultaneously carrying out twisted- quantity correction 
in a three-dimensional space defined by a linear combination of the ink 
quantities with the correction in the ink-quantity space. In the following 
section is defined the cost Evt based on the twisted quantity in the 
tree -dimensional space defined by the linear combination of the ink 
quantities (referred to as virtual CMY hereinafter). 

In exactly the same manner as the case of Eit, it is assumed that the 
respective grid points retain a virtual CMY vector. Based on this 
assumption, the virtual CMY vectors retained respectively at the grid points 
"p"> Pr> Pt, and ptr are denoted as V p , V pr , V p t, and V p tr. The virtual CMY 



30 



FEP0208PCT 



PCT/JP03/00110 



vector includes linearly combined elements of the ink-quantity vector using 
proper combination coefficients, and, by replacing I with V in the equation 
(A- 1-3), and using a 3 x I conversion matrix K (V P =KI P ) from the 
ink-quantity vector to the virtual CMY vector, the cost Evt of the twisted 
quantity in the virtual CMY space is represented as an equation (A- 1-4). It 
should be noted that I is the number of elements of the ink-quantity vector. 



where Dvt denotes a transition distance at "t", and is the magnitude of a 
difference vector between virtual CMY vectors respectively at the grid points 
V and p t . 

Comparison of the equation (A- 1-4) to the second equation of the 
equation (A- 1-2) revels that both of them have the same form as in the case 
of the equation (Al-3). 

(A- 1-5) Cost E s due to deviation from target ink quantities 

If it is assumed that an ink quantity vector It is an ideal (target) 
vector, it can be considered that the larger a difference vector between the 
ink-quantity vector I p at the grid point "p" and the vector It becomes, the 
more the cost increases. This cost is denoted as E s , and is represented by an 
equation (A- 1-5). It should be noted that W s is an I x I diagonal matrix, and 
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is a weight matrix for the respective elements of the ink- quantity vector. 



It can be confirmed that the equation (A- 1-5) also has the same form 
as the second equation of the equation (A- 1-2). 

It is not realistic that the ideal ink-quantity vector It is known in 
advance, and thus, an ink- quantity vector closer to the ideal state or an 
ink-quantity vector as another target may be employed. 

(A- 1-6) Cost E v due to deviation from target virtual CMY 

On the assumption that a virtual CMY vector Vt is ideal for the 
virtual CMY vector V p at the grid point "p'\ this cost E v is denoted as an 
equation (A-l"6) using the conversion matrix K in the same manner as the 
equation (A - 1*5). 



where W v is a 3 x 3 diagonal matrix, and is a weight matrix for the respective 
elements of the virtual CMY vector. It can be confirmed that the equation 



= |Ws-(I p -It)| 2 



• • • (A— 1 — 5) 



£v = |Wv(K-Ip- Vt)| 2 



• • • (A— 1—6) 
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(A- 1-6) also has the same form as the second equation of the equation (A-l-2). 

It is not realistic that an ideal virtual CMY vector Vt is known in 
advance as in the case of It, and thus, a virtual CMY vector closer to the 
ideal state or a virtual CMY vector as another target may be employed. 

(A- 17) Cost Ed due to violation of ink quantity limitation 

In terms of various combinations of the elements of the ink-quantity 
vector, there is such a cost relating to excesses of sums of these ink quantities 
from certain limits. If the ink quantities are excessive, inks spread, and 
cause an unfavorable result, and thus, this cost is evaluated. 

On this occasion, it is assumed that a conversion matrix N from the 
ink-quantity vector I p to a vector representing the sums of the combinations 
of the ink quantities (referred to as combination vector hereinafter) D p 
(Dp=N I p ), and a vector Dl contains these limits, and if respective elements of 
a difference vector between D p and Dl are positive, it is assumed that costs 
are present. This situation is represented by an equation (A- 1-7). 



where Wdi is a column vector having D of elements, Wd2 is a diagonal matrix 
having D x D of elements, and both are a weight vector and a weight matrix 



Ed = < 



'Wdi' -(N-Ip-Dl) 
|Wd2-(N-I P -D L )| 2 



• • • (A-1-7) 
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representing weights. The respective weight elements of Wdi and Wd2 may- 
be 0 according to negative/positive of the elements of the difference vector 
between D p and Dl. It should be noted that D is the number of the elements 
of the combination vector. 

The equation (A- 1-7) has a linear equation form and a quadratic 
equation form, and either of them is selected when used. The comparison of 
the equation (A- 1-7) to the equation (A- 12) reveals that both the linear 
equation form and the quadratic equation form are the same as those of the 
equation (A- 12). 

(A- 1-8) Cost En due to ink quantity reduced to minus 

It is assumed that if the respective elements of the ink- quantity 
vector I p are negative, the cost increases. This is represented by an 
equation (A- 1-8). 



where W n i denotes a weight vector having I of elements, and W n 2 is an I x I 
diagonal matrix, and is a weight matrix. The respective weight elements of 
Wni and W n 2 have a negative magnitude if the respective elements of the 
ink-quantity vector I p have a negative value. 



En = < 



Wni" ' Ip 
WnZ'Ip 



• • • (A- 1-8) 
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The equation (A- 1-8) also has a linear equation form and a quadratic 
equation form, and either of them is selected. The comparison of the 
equation (A* 1-8) to the equation (A- 1*2) reveals that both the linear equation 
form and the quadratic equation form are the same as those of the equation 
(A- 1-2), though parts of both the forms can be omitted. 

(A- 1-9) Cost Eob relating to ink generation 

If certain elements of the ink- quantity vector I P should not retain 
positive values, this cost is produced if they do. If the generation of the inks 
is carried out earlier, visibility of dots increases, and thus, the graininess 
degrades, and therefore this cost is evaluated. This is represented by an 
equation (A- 19): 



where Wobi denotes a weight vector having I of elements, and W G b2 is an I x I 
diagonal matrix, and is a weight matrix. The respective weight elements of 
the Wobi and Wob2 are positive if certain elements of the ink- quantity vector 
I p are positive, and simultaneously should not take a positive value. 

The equation (A l-9) also has a linear equation form and a quadratic 
equation form, and either of them is selected. It can also be confirmed that 
though both the linear equation form and the quadratic equation form 




• • • (A- 1-9) 
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include omitted parts, they are the same as those in the equation (A- 1-2) 
based on the comparison of the equation (A-l-9) to the equation (A- 1-2). 

After the respective costs are calculated using the above (A-l-l) 
through (A- 1-9), the following smoothing processing is carried out. 

Smoothing processing (step S24) 

As Fig. 5 shows, then, the color conversion LUT smoothing unit 20e 
of the color conversion table producing device 20A carries out the smoothing 
processing (calculation of I p which minimizes the evaluation function E) (step 
S24) detailed below. 

(A-l-l) Outline of LUT smoothing at grid point "p" 

Smoothing of the LUT at the grid point "p" is carried out by 
minimizing the evaluation function E represented by the equation (A- 1*1). 
Though an arbitrary method for minimizing the evaluation function E 
represented by the equation (A-l-l) may be used, the present embodiment 
employs the following method. 

The respective terms in the equation (A-l-l) are represented as a 
sum of the equations (A- 1-3) through (A-l-9). Namely, all of the terms of the 
evaluation function E include the respective elements of I p , and are 
represented as high as the quadratic form in terms of these elements. 
Further, the quadratic form is the square of the linear form, and is always a 
downwardly convex function. Namely, the evaluation function E takes the 
minimum value for I p which equates function obtained by partially 
differentiating E by the respective elements of I p to a zero vector. 
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As described above, all of the equations (A- 1-3) through (A- 1-9) take 
the same form as the equation (A- 1-2). Hereinafter, the equation (A- 1-2) is 
used to show a general form of a case where the respective terms of the 
evaluation function E are partially differentiated by the respective elements 
of I P (X in the case of the equation (A- 1-2)). An equation (A-l-10) shows a 
case where the equation (A- 1-2) is partially differentiated by the respective 
elements of X. 



where A denotes a column vector having X of elements, and the respective 
elements are obtained by partially differentiating E c by the respective 
elements X x of X. It should be noted that Y is the element number of the 
vector X, and x=l, 2, X. 

(A- 1-2) Partial differentiation of evaluation function E by elements of I p 

The following section shows partially differentiated equations (A- 13) 
through (A- 1-9) by the respective elements of I P as in the case of the equation 
(A-l-10). In the following equations, Ait, Avt, As, A v , Aa, An, and A>b denote 
column vectors of the element number of I respectively obtained by partially 




• • • (A-l-10) 
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differentiating En, Evt, E S) E v , Ed, E n , and E Q b by the respective elements I p i of 
I P . It should be noted that "i" is the element number of the vector I p , and i=l, 
2,...,I. 



dEu dEu dEu \' 

dlpi dip- dlpi 



t r 2 

= y y~ (lp + I|«r-Ipr-Ip.) 

&* D > ... (A-l-12) 
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Aob = 




dEob V 



dip. 



dip! ) 



rWoM 



2Wob2 2 -Ip 



(A- 1-18) 



The sum of the equations (A- 1-12) through (A- 1-18) is a vector 
obtained by partially differentiating the evaluation function E by the 
respective elements of I p . It is assumed that this vector is a zero vector, and 
this equation is solved for I p , there can be obtained I p which minimizes E. 
Namely, it means to solve- 

f (l P ) = Ait + Avt + As + Av + Ad + An + Aob 



for I p . It should be noted that "f denotes a vector obtained by partially 



differentiating E by the respective elements of I p represented in a function 
form, and "0" denotes a zero vector. Of respective terms on the right side of 
a first equation of the equation (A- 1-19), there are used only terms 
corresponding to the terms selected in the evaluation function of the 
equation (A"l-l). 

As described above, the color conversion LUT smoothing unit 20e 
obtains I P which minimizes the evaluation function E, and then, terminates 
the smoothing processing. 



= 0 



• • • (A- 1-19) 
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Smoothing processing across overall LUT (step S25) 
As Fig. 5 shows, then, the color conversion LUT smoothing unit 20e 
of the color conversion table producing device 20A carries out smoothing 
processing across the entire LUT (step S25) detailed below. 

For carrying out the smoothing processing across the entire LUT, if it 
is possible to correct only I p without changing the ink-quantity vectors 
retained on the grid points other than the grid point "p", it is possible to 
obtain an optimal I p in the method described above. However, in a more 
realistic case, it is actually necessary to correct the ink-quantity vectors 
retained on the grid points other than the grid point "p" for smoothing across 
the entire LUT. Therefore, the smoothing across the entire LUT is carried 
out by repeating sequential correction of the ink-quantity vectors at the 
respective grid points. 

If the correction of the ink-quantity vector at the grid point "p" in a 
state "n" to a next state (solving the equation (A- 1-19) for I p ) is denoted as "g", 
this correction is generally represented as an equation (A l~20)- 



If the correction from the state V to the state "n+1" is carried out at all the 
grid points, the costs E at the respective grid points are not always reduced. 
As the equation (A- 1-20) shows, the ink-quantity vectors in the state "n+1" 




• • • (A- 1-20) 
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are obtained for the respective grid points based on the cost E in the state "n", 
and thus, the cost E in the state "n+l" is not considered for obtaining the 
equation (A- 1-20). Namely, though, due to the purpose of reducing the cost, 
it is expected that the cost in the state "n+l" is smaller than the cost in the 
state "n" at most of the grid points, it does not always hold true. 

Therefore, (l) the correction is carried out at the entire grid points 
using the equation (A- 1-20) (step S40), (2) the correction which increases the 
cost is not carried out (step S54), or (3) the correction by annealing which 
increases the cost by a certain degree of a small amount is permitted (step 
S56). 

Then, with reference to a flowchart shown in Fig. 6, more detailed 
description will now be given of the smoothing processing across the entire 
LUT shown in the step S25 in Fig. 5. 

As Fig. 6 shows, when the smoothing processing across the entire 
LUT starts in the step S25, 0 (zero) is set to "n" in the equation (A- 1-20) (step 
S30), and the ink-quantity vectors I- 




(p=0, 1, P-l) are input (step S32). Reference numeral P denotes the 
number of the grid points. 

Then, it is determined whether "n<N" or not (step S34), and if "n<N" 
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holds ("Yes" in the step S34), the costs at the respective grid point "p" in the 
state "n": 




(p=0, 1, P-l) are calculated (step S36), the ink-quantity vectors in the 
certain state "n" at the respective grid point "p" (p=0, 1, P-l) are obtained 
using the equation (A- 1-20), and a variable "Count" is set to P (step S38). 

Reference numeral N denotes how many times the smoothing is 
carried out, and indicates that the maximum value of the state "n" is N-l. 

If a condition "all of the grid points are not corrected" holds ("No" in 
the step S40), "p" is set to 0 (zero) (step S42), and it is determined whether 
"p<P" or not (step S44). 

Alternatively, if a condition "all of the grid points are corrected" holds 
("Yes" in the step S40), or "p<P" does not hold ("No" in the step S44), and 
"Count" is not 0 (zero) ("No" in a step S46), "n+1" is set to "n", and probability 
variable parameters for the annealing are decreased (step S48), and the 
procedure returns to the step S34. 

Alternatively, if "p<P" holds ("Yes" in the step S44), the cost for the 
grid point "p" in the state "n+1": 
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is calculated (step S50), and it is determined whether: 





or not (step S52). If the cost at the grid point "p" in the state "n+1" is equal 
to or more than the cost at the grid point "p" in the state "n" ("No" in a step 
S52), it is determined whether a condition "not corrected unless cost 
decreases" holds (step S54), and if the condition "not corrected unless cost 
decreases" does not hold in the step S34 ("No" in the step S54), it is 
determined whether a condition "correction with annealing is permitted" 
holds (step S56). 

If the condition "not corrected unless cost decreases" holds ("Yes" in 
the step S54), or the condition "correction with annealing is not permitted" 
holds ("No" in the step S56), the ink-quantity vector at the grid point "p" in 
the state "n": 



is set to the ink- quantity vector at the grid point "p" in the state "n+1": 





n+1 



43 



FEP0208PCT 



PCT/JP03/00110 



and, simultaneously, the variable (Count- 1) is set to "Count" (step S60). 

Then, after the step S60, or if the cost at the grid point "p" in the 
state "n+1" is less than the cost at the grid point "p" in the state "n" ("Yes" in 
the step S52), or if the condition "correction with annealing is permitted" 
holds ("Yes" in the step S56), "p+1" is set to "p" (step S58), and the procedure 
returns to the step S44. 

Alternatively, if "n<N" does not hold in the step S34 ("No" in the step 
S34), or "Count" is 0 in the step S46 ("Yes" in the step S46), the ink-quantity 
vectors" 

yn+1 

P 

(p=0, 1, P-l) are output (step S62), and the procedure terminates. 

Then, after the smoothing processing across the entire LUT (step 
S25), the procedure returns to the step S26 in Fig. 5, the color conversion 
table is produced (step S26), and the produced color conversion table is 
stored in the color conversion LUT storing unit 20b (step S28). 

The procedure described above can produce the color conversion table 
capable of enhancing the continuity of the color conversion of the image data. 

Image processing device 

In Fig. 3, the image processing device 20B applies desired image 
processing to RGB image input data, and outputs the processed image data 
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to an image output device 30. 

The image data are produced by separating a color image into 
respective predetermined element colors, and representing intensities in 
these respective element colors, which are chromatic colors, and may be 
mixed into achromatic colors typified by gray and black if they are mixed at 
predetermined ratios. 

In the present embodiment, a description will be given of a case 
where the image output device is a color printer using inks in six colors* C 
(cyan), M (magenta), Y (yellow), K (black), c (light cyan), and m (light 
magenta), and reproducing colors based on the RGB data. 

The image processing device 20B is comprised of a first color 
converting unit 20d which converts the RGB image data to CMY image data, 
a color conversion LUT storing unit 20b which stores at least the color 
conversion table produced by the color conversion table producing device 2 OA, 
and a second color converting unit 20a which reads a color conversion table 
(LUT) selected by a color conversion LUT selecting unit 20c from the color 
conversion LUT storing unit 20b, and refers to the read color conversion LUT 
thereby converting the CMY data to CMYKcm data. 

A description will now be given of an operation of the image 
processing device 20B with reference to Fig. 4. 

As Fig. 4 shows, if the user instructs the image output start (step 70), 
and a predetermined color conversion LUT is selected ("Yes" in a step 72), the 



45 



FEP0208PCT 



PCT/JP03/00110 



predetermined color conversion LUT is read from the color conversion LUT 
storing unit 20b, and read into a RAM (step 74). Then, the color conversion 
LUT is built into the second color converting unit 20a (step 76), the 
three-dimensional color conversion LUT is referred to to carry out image 
processing using interpolation, and image output processing is carried out 
(step 78). 

According to the image processing device of the present embodiment, 
if in the step 72 is selected a color conversion table which is produced by the 
color conversion table producing device 20A, and can enhance the continuity 
of the color conversion of the image data, the color conversion is carried out 
using the color conversion table, and thus, the tone jump after the color 
conversion can be prevented. 

(A-2) Second example 

Using a smoothing level evaluation function used for evaluating a 
smoothing level at respective lattice point data after color conversion by a 
color conversion table in a perceptually uniform color space such as the Lab 
space. 

A function block diagram of a color conversion table producing device 
according to a second example is the same as the block diagram of the first 
example shown in Fig. 1. Fig. 8 shows a function block diagram of an image 
processing device according to the second example. 

Hardware constitution 

Specific hardware constitution examples of a color conversion table 
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producing device and the image processing device according to the second 
example are the same as those shown in the schematic block diagram 
according to the first example in Fig. 2, and thus, a description will be 
omitted. 

Image processing control program 

An image processing control program according to the present 
invention is usually recorded on a recording medium such as a floppy disk or 
a CD-ROM in a form readable by a computer 12, and circulated. The 
program is read by a media reader (such as a CD-ROM drive 13c and a floppy 
disk drive 13a), and then, installed on a hard disk 13b. There is such a 
constitution that a CPU then properly reads a desired program from the 
hard disk 13b, and carries out desired processing. It should be noted that 
the image processing control program according to the present invention 
itself constitutes a part of the invention of the present application. 

In the second example, the color conversion table producing device 
20A shown in Fig. 1 produces the color conversion table which converts the 
Lab image data converted from the RGB (sRGB) image data to La'b' image 
data adapted to a color space of an image output device. This color 
conversion table produce a color conversion table capable of enhancing 
continuity of the color conversion of the image data when the Lab image data 
is converted to the L'a'b' image data. In the present embodiment as an 
example of the color conversion in the perceptually uniform color space, a 
description will be given of color conversion in the Lab space. 

As in the first example, the color conversion table producing device 
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20 A according to the second example shown in Fig. 1 is comprised of a cost 
calculating unit 20d, a color conversion table (LUT) smoothing unit 20e, a 
color conversion table (LUT) producing unit 20f, and a color conversion table 
(LUT) storing unit 20b. A detailed description will be given of processing in 
these respective components later. 

A description will now be given of a color conversion table producing 
program executed by the color conversion table producing device 20A shown 
in Fig. 1 with reference to Figs. 5, 9, and 10. 

Color conversion table producing processing carried out by the color 
conversion table producing device 20A according to the second example is the 
same as that presented in the flowchart describing the color conversion table 
producing processing by the color conversion table producing device 20A 
according to the first example shown in Fig. 5. 

Calculation of respective costs (step S22) 

As Fig. 5 shows, first, the cost calculating unit 20d of the color 
conversion table producing device 20A calculates respective costs in a 
function (referred to as "evaluation function" hereinafter) E for evaluating a 
level of smoothing of data at respective lattice points (grid points) after the 
color conversion using the color conversion table (step S22). A detailed 
description will now be given of the evaluation function E. 

(A-21) The evaluation function E is designed so as to have a smaller value if 
respective conditions are satisfied for a certain grid point in the LUT. If 
smoothing processing is applied to an Lab vector, the evaluation function E is 



48 



FEP0208PCT 



PCT/JP03/00110 



represented as a sum of cost terms designed based on the respective 
conditions- 

E=E lt +E 1 (A-2-1) 

where-' 

Eit is a cost due to a twisted quantity of an Lab vector, and 
Ei is a cost due to a deviation from target Lab. 

The Eit is a cost relating to a twist between grid points neighboring 
each other, and it is possible to enhance the continuity of the image data 
after the color conversion by reducing Eit, thereby reducing the twist 
between the neighboring grid points caused by the conversion from Lab to 
L'a'b\ Ei is a cost produced by a difference between the Lab vectors before 
and after the smoothing, and relates to a difference of the Lab vectors caused 
by a chronological change of the same grid points. 

A detailed description will now be given of the respective terms. The 
equation (A-2-l) shows an example of smoothing the Lab vector, and 
application to other vectors (for example, vectors in XYZ, CMY, and other 
spaces) may be carried out in the same manner. 

(A-2-2) General forms of respective terms of evaluation function E 

A cost term E c of the evaluation function relating to a certain vector X 
is generally represented by the following equation* 
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Ec = < 



'Wi'-(M-X 
|W 2 -(M-X 



Yt) 
Yt) 



• • • (A-2-2) 



where- 

E c is a cost (scalar), 

X is a column vector having X of elements, 

M is a Y x X matrix used for converting the vector X to a vector Y=M X, 
which is a vector having Y of elements subject to the cost, 
Yt is a column vector having Y of elements, 

Wi is a column vector having Y of elements, and represents weights for the 
cost assigned to the respective elements of a vector Y— Yt, 

W2 is a Y x Y diagonal matrix, and represents weights for the cost assigned 
to the respective elements of the vector Y-Yt, and 
"t" denotes transposition. 

In the following description, a first equation and a second equation of 
the equation (A-2-2) are respectively referred to as a linear equation form 
and a quadratic equation form. 

(A-2-3) Cost Eit due to twisted quantity of Lab vector (Lab vector space) 

A grid point neighboring a certain grid point "p" is denoted as p r 
(referred to as "reference grid point" hereinafter). A grid point other than 
the grid point p r neighboring the certain grid point "p" is denoted as p t 
(referred to as "transition grid point" hereinafter), and a grid point which has 
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the same positional relationship with the grid point p t as that the grid point 
"p" has with the grid point p r is denoted as ptr. It is assumed that the 
respective grid points "p", p r , pt, and ptr retain Lab vectors Lp, Lp r , Lpt, and 

Lptr. 

Fig. 10 shows positional relationship of these grid points and the Lab 
vectors retained by these grid points. In Fig. 10, if it is considered that a 
difference vector between Lpr and Lp is transitioned to a difference vector 
between Lptr and Lpt, "a displacement of the difference vector before and after 
the transition" is represented as a difference vector between these difference 
vectors. In addition, if a transition distance is considered as the magnitude 
of the difference vector between Lpt and Lp, a "displacement of the difference 
vector before and after the transition per unit transition distance" is 
obtained by dividing "displacement of the difference vector before and after 
the transition" by the transition distance. The twisted quantity of the Lab 
vector at the grid point "p" is defined by adding the square of the magnitude 
of the "displacement of the difference vector before and after the transition 
per unit transition distance" for all of the grid points p r and pt neighboring 
the grid point "p". It should be noted that p r and pt may be the same grid 
point as long as they are neighboring "p". 

This twisted quantity of the Lab vector is represented as a cost in an 
equation (A-2-3): 
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Eh = 




L, 



P + J^/ptr — J^pr — J-jpt 



Dit 



• • • (A-2-3) 



In the equation (A- 2 -3), 

"t" denotes a certain p t , 

T denotes the number of pt, 

"r" denotes a certain p r , 

R denotes the number of p r , and 

Dit denotes a transition distance at "t". 

The smaller the cost Eit becomes, the more the twisted quantity in 
the Lab space can be reduced. 

Comparison of the equation (A-2-3) to the second equation of the 
equation (A-2-2) reveals that it is not necessary to convert the Lab vector to a 
vector in other space, and thus, M is represented as a unit vector, and can be 
omitted. The respective elements are not multiplied by the weights, and 
thus, the W2 is also a unit vector, and can be omitted. X corresponds to Lp, 
and Yt corresponds to Lptr-Lpr-Lpt. 1/Dit 2 is a constant for a certain "t", and 
thus, the equation (A-2-2) has the same form as the second equation of the 
equation (A-2-3). 

(A-2-4) Cost Ei due to deviation from target Lab 

If an Lab vector Lt is an ideal (target) vector, it can be considered 
that the larger a difference between the Lab vector Lp at the grid point "p" 
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and the vector Lt becomes, the more the cost increases. This cost is denoted 
as Ei, and is represented by an equation (A-2-4). It should be noted that Wi 
is a 3 x 3 diagonal matrix, and is a weight matrix for the respective elements 
of the Lab vector. 



It can be confirmed that the equation (A-2-4) also has the same form as the 
second equation of the equation (A22). 

It is not realistic that the ideal Lab vector Lt is known in advance, 
and thus, an Lab vector closer to the ideal state or an Lab vector as another 
target may be employed. On this occasion, as the Lab vector closer to the 
ideal state, the Lab vector before the smoothing is used. This is because it 
is expected that as the smoothing progresses, the Lab vector at the grid point 
comes closer to the ideal value, and the restriction on time of the smoothing 
is also considered. 

After the respective costs are calculated using the above (A-2-l), 
(A-2-3), and (A-2-4), the following smoothing processing is carried out. 

Smoothing processing (step S24) 

As Fig. 9 shows, then, the color conversion LUT smoothing unit 20e 
of the color conversion table producing device 20A carries out smoothing 
processing (calculation of Lp which minimizes the evaluation function E) 
(step S24) detailed below. 




• • • (A-2-4) 
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(A-2- 1) Outline of LUT smoothing processing at grid point "p" 

Smoothing of the LUT at the grid point "p" is carried out by 
minimizing the evaluation function E represented by the equation (A-2-l). 
Though an arbitrary method for minimizing the evaluation function E 
represented by the equation (A-2-l) may be used, the present embodiment 
employs the following method. 

The respective terms in the equation (A-2-l) are represented as a 
sum of the equations (A-2-3) and (A-2-4). Namely, all of the terms of the 
evaluation function E include the respective elements of the Lp, and are 
represented as high as the quadratic form in terms of these elements. 
Further, the quadratic form is the square of the linear form, and is always a 
downwardly convex function. Namely, the evaluation function E takes the 
minimum value for the Lp which equates function obtained by partially 
differentiating E by the respective elements of Lp to a zero vector. 

As described above, both of the equations (A-2-3) and (A-2-4) take the 
same form as the equation (A-2-2). Hereinafter, the equation (A-2-2) is used 
to show a general form of partial differentiation of the respective terms of the 
evaluation function E by the respective elements of Lp (X in the case of the 
equation (A-2-2)). An equation (A-2 -5) shows a case where the equation 
(A-2-2) is partially differentiated by the respective elements of X. 
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A = 



/ dEc dEc dEc V 

( • • • • • • - ■ ■ I 



'(wi'-m)' 

' 2(W 2 -M )'-W2-(M-X-Yt) 



• • • (A-2-5) 



where A denotes a column vector having X of elements, and the respective 
elements are obtained by partially differentiating E c by the respective 
elements X x of X. It should be noted that "x" is the element number of the 
vector X, and x=l, 2, X. 

(A-2-2) Partial differentiation of evaluation function E by elements of Lp 

The following section shows partially differentiated equations (A-2-3) 
and (A-2-4) by the respective elements of Lp as in the case of the equation 
(A-2-5). In the following equations, Ait and Ai denote column vectors having 
three elements respectively obtained by partially differentiating Eit and Ei by 
the respective elements of LpL, Lpa> and Lpb of Lp. 




• • • (A-2-6) 
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A. = 



dEi BEi 



dEi V 





• • • (A-2-7) 



= 2Wi 2 -(L p -Lt) 



The sum of the equations (A-2-6) and (A-2-7) is a vector obtained by 
partially differentiating the evaluation function E by the respective elements 
of Lp. If it is assumed that this vector is a zero vector, and this equation is 
solved for Lp, there can be obtained Lp which minimizes E. Namely, it 
means to solve- 



for Lp. It should be noted that "f is a vector obtained by partially 
differentiating E by the respective elements of Lp, and is represented in a 
function form, and "0" denotes a zero vector. 

As described above, the color conversion LUT smoothing unit 20f 
obtains Lp which minimizes the evaluation function E, and then, terminates 
the smoothing processing. 

Smoothing processing across overall LUT (step S25) 
As Fig. 5 shows, then, the color conversion LUT smoothing unit 20e 
of the color conversion table producing device 20A carries out smoothing 
processing across the entire color conversion LUT (step S25) detailed below. 




• • • (A-2-8) 



= 0 
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For carrying out the smoothing processing across the entire LUT, if it 
is possible to correct only Lp without changing the Lab vectors retained on 
the grid points other than the grid point "p", it is possible to obtain an 
optimal Lp in the method described above. However, in a more realistic case, 
it is actually necessary to correct the Lab vectors retained on the grid points 
other than the grid point "p" for smoothing processing across the entire color 
conversion LUT. Therefore, the smoothing across the entire color 
conversion LUT is carried out by repeating sequential correction of the Lab 
vectors at the respective grid points. 

If the correction of the Lab vector at the grid point "p" in a state V to 
a next state (solving the equation (A-2-8) for Lp) is denoted as "g", this 
correction is generally represented as an equation (A-2-9)- 




• • • (A-2-9) 



If the correction from the state "n" to the state "n+1" is carried out at all the 
grid points, the costs E at the respective grid points are not always reduced. 
As the equation (A-2-9) shows, the Lab vectors in the state "n+1" are 
obtained for the respective grid points based on the cost E in the state "n", 
and thus, the cost E in the state "n+1" is not considered for obtaining the 
equation (A-2-9). Namely, though, due to the purpose of reducing the cost, 
it is expected that the cost in the state "n+1" is smaller than the cost in the 
state V at most of the grid points, it does not always hold true. 
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Therefore, (l) the correction is carried out at the entire grid points 
using the equation (A-2-9) (step S40), (2) correction which increases the cost 
is not carried out (step S54), or (3) correction by annealing which increases 
the cost by a certain degree of a small amount is permitted (step S56). 

Then, with reference to a flowchart shown in Fig. 5, more detailed 
description will now be given of the smoothing processing across the entire 
color conversion LUT shown in S25 in Fig. 5. 

As Fig. 5 shows, when the smoothing processing across the entire 
color conversion LUT starts in S25, 0 (zero) is set to "n" in the equation 
(A-2-9) (step S30), and the Lab vectors: 



(p=0, 1, P-l) are input (step S32). Reference numeral P denotes the 
number of the grid points. 

Then, it is determined whether "n<N" or not (step S34), and if "n<N" 
holds ("Yes" in the step S34), the costs at grid point "p" in the state "n"-" 



(p=0, 1, P-l) are calculated (step S36), the Lab vectors in the certain 
state "n" at the respective grid point "p" (p=0, 1, P-l) are obtained using 




E n 

p 
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the equation (A-2-10), and a variable "Count" is set to P (step S38). 

Reference numeral N denotes how many times the smoothing is 
carried out, and indicates that the maximum value of the state V is N-l. 

If a condition "all of the grid points are not corrected" holds ("No" in 
the step S40), "p" is set to 0 (zero) (step S42), and it is determined whether 
"p<P" or not (step S44). 

Alternatively, if a condition "all of the grid points are corrected" holds 
("Yes" in the step S40), or "p<P" does not hold ("No" in the step S44), and 
"Count" is not 0 (zero) ("No" in a step S46), "n+1" is set to "n", and probability 
variable parameters for the annealing are decreased (step S48), and the 
procedure returns to the step S34. 

Alternatively, if "p<P" holds ("Yes" in the step S44), the cost for the 
grid point "p" in the state "n+1": 




is calculated (step S50), and it is determined whether : 




or not (step S52). If the cost at the grid point "p" in the state "n+1" is equal 
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to or more than the cost at the grid point "p" in the state "n" ("No" in a step 
S52), it is determined whether a condition "not corrected unless cost 
decreases" holds (step S54), and if the condition "not corrected unless cost 
decreases" does not hold ("No" in the step S54), it is determined whether a 
condition "correction with annealing is permitted" holds (step S56). 

If the condition "not corrected unless cost decreases" holds ("Yes" in 
the step S54), or the condition "correction with annealing is not permitted" 
holds ("No" in the step S56), the Lab vector at the grid point "p" in the state 




is set to the Lab vector at the grid point "p" in the state "n+1": 




and, simultaneously, the variable (Count- 1) is set to "Count" (step S60). 

Then, after the step S60, or if the cost at the grid point "p" in the 
state "n+1" is less than the cost at the grid point "p" in the state "n" ("Yes" in 
the step S52), or the condition "correction with annealing is permitted" holds 
("Yes" in the step S56), (p+l) is set to "p" (step S58), and the procedure 
returns to the step S44. 
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Alternatively, if "n<N" does not hold in the step S34 ("No" in the step 
S34), or "Count" is 0 ("Yes" in the step S46), the Lab vector: 

t n+1 

(p=0, 1, P-l) are output (step S62), and the procedure terminates. 

Then, after the smoothing processing across the entire LUT (step 
S25), the procedure returns to the step S26 in Fig. 5, the color conversion 
table is produced (step S26), and the produced color conversion table is 
stored in the color conversion LUT storing unit 20b (step S28). 

The procedure described above can produce the color conversion table 
capable of enhancing the continuity of the color conversion of the image data. 

Image processing device 

In Fig. 8, the image processing device 20B applies desired image 
processing to RGB image data, and outputs the processed image data to an 
image output device 30. 

The image data are produced by separating a color image into 
predetermined element colors, and representing intensities in these 
respective element colors, which are chromatic colors, and may be mixed into 
achromatic colors typified by gray and black if they are mixed at 
predetermined ratios. 
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In the present embodiment, a description will be given of a case 
where the image output device is a color printer using inks in six colors^ C 
(cyan), M (magenta), Y (yellow), K (black), c (light cyan), and m (light 
magenta), and reproducing colors based on the RGB data. 

The image processing device 20B is comprised of a first color 
converting unit 20h which converts the RGB image data to Lab image data, a 
color conversion LUT storing unit 20b which stores at least the color 
conversion table produced by the color conversion table producing device 20A, 
a second color converting unit 20a which reads a color conversion table 
(LUT) selected by a color conversion LUT selecting unit 20c from the color 
conversion LUT storing unit 20b, refers to the read color conversion LUT 
thereby converting the Lab image data to L'a'b' image data, and a third color 
converting unit 20g which converts the L'a'b' image data to CMYKcm image 
data. 

A description will now be given of an operation of the image 
processing device 20B with reference to Fig. 4. 

As Fig. 4 shows, if the user instructs the image output start (step 70), 
and a predetermined color conversion LUT is selected through the color 
conversion LUT selecting unit 20c ("Yes" in a step 72), the predetermined 
color conversion LUT is read from the color conversion LUT storing unit 20b, 
and read into a RAM (step 74). Then, the color conversion LUT is built into 
the second color converting unit 20a (step 76), the three-dimensional color 
conversion LUT is referred to to carry out image processing using 
interpolation, and image output processing is carried out (step 78). 
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According to the image processing device 20B according to the 
present embodiment, if in the step 72 is selected a color conversion table 
which is produced by the color conversion table producing device 20A, and 
can enhance the continuity of the color conversion of the image data, the 
color conversion is carried out using the color conversion table, and thus, the 
tone jump after the color conversion can be prevented. 

(A- 3) Third example 

Using a smoothing level evaluation function used for evaluating a 
smoothing level at respective lattice point data after the color conversion by 
a color conversion table in a color space such as the CMY space 

A function block diagram of a color conversion table producing device 
according to a third example is the same as the function block diagram of the 
first and second examples shown in Fig. 1. Fig. 19 shows a function block 
diagram of an image processing device according to the third example. 

Hardware constitution 

Specific hardware constitution examples of a color conversion table 
producing device and the image processing device according to the third 
example are the same as those shown in the schematic block diagram 
according to the first and second examples in Fig. 2, and thus, a description 
will be omitted. 

Image processing control program 

An image processing control program according to the present 
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invention is usually recorded on a recording medium such as a floppy disk or 
a CD-ROM in a form readable by a computer 12, and circulated. The 
program is read by a media reader (such as a CD-ROM drive 13c and a floppy 
disk drive 13a), and then, is installed on a hard disk 13b. There is such a 
constitution that a CPU then properly reads a desired program from the 
hard disk 13b, and carries out desired processing. It should be noted that 
the image processing control program according to the present invention 
itself constitutes a part of the invention of the present application. 

The color conversion table producing device 20A shown in Fig. 1 
produces the color conversion table which converts CMY data represented as 
complements of RGB (sRGB) image data to CMY image data adapted to a 
color space of an image output device. This color conversion table produces 
a color conversion table capable of enhancing continuity of the color 
conversion of the image data when the CMY image data is converted to 
CMY image data. In the present embodiment as an example of the color 
conversion, a description will be given of the color conversion in the CMY 
space. 

In Fig. 1, the color conversion table producing device 20 A is 
comprised of a cost calculating unit 20d, a color conversion table (LUT) 
smoothing unit 20e, a color conversion table (LUT) producing unit 20f, and a 
color conversion table (LUT) storing unit 20b. A detailed description will be 
given of processing in these respective components later. 

A description will now be given of a color conversion table producing 
program executed by the color conversion table producing device 20A shown 
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in Fig. 1 with reference to Figs. 5 through 12. 

Fig. 5 shows a flowchart describing color conversion table producing 
processing by the color conversion table producing device 20A. 

Calculation of respective costs (step S22) 

As Fig. 5 shows, first, the cost calculating unit 20d of the color 
conversion table producing device 20A calculates respective costs in a 
function (referred to as "evaluation function" hereinafter) E for evaluating a 
level of smoothing of data at respective lattice points (grid points) after the 
color conversion using the color conversion table (step S22). A detailed 
description will now be given of the evaluation function E. 

(A-31) The evaluation function E is designed so as to have a smaller value if 
respective conditions are satisfied for a certain grid point in the LUT. If 
smoothing processing is applied to a CMY vector, the evaluation function E is 
represented as a sum of cost terms designed based on the respective 
conditions- 

E=E vt +E v +E d +E n (A-3-1) 

where- 

Evt is a cost due to a twisted quantity of a CMY vector, 
E v is a cost due to a deviation from target CMY, 
Ed is a cost due to an excess of the CMY value from 255, and 
E n is a cost due to a CMY value reduced to minus. 
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The Evt is a cost relating to a twist between grid points neighboring 
each other, and it is possible to enhance the continuity of the image data 
after the color conversion by reducing E v t, thereby reducing the twist 
between the neighboring grid points caused by the conversion from CMY to 
C'MT. E v is a cost produced by a difference between the CMY vectors 
before and after the smoothing, and related to the differences of the CMY 
vectors caused by a chronological change of the same grid points. Ed and E n 
are costs produced if the CMY value does not fall within a range from 0 to 
255 when the CMY value is normalized to that range. 

A detailed description will now be given of the respective terms. The 
equation (A-3-l) shows an example of smoothing the CMY vector, and 
application to other vectors (vectors in XYZ, Lab, and other spaces) may be 
carried out in the same manner. 

(A-3-2) General forms of respective terms of evaluation function E 

A cost term E c of the evaluation function relating to a certain vector X 
is represented by the following equation* 



where* 

E c is a cost (scalar), 

X is a column vector having X of elements, 

M is a Y x X matrix used for converting the vector X to a vector Y=M X, 



Ec = < 



r Wi'-(M-X 
|W 2 -(M-X 



Yt) 
Yt) 



• • • (A-3-2) 
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which is a vector having Y of elements subject to the cost, 
Yt is a column vector having Y of elements, 

Wi is a column vector having Y of elements, and represents weights for the 
cost assigned to the respective elements of a vector YYr, 

W2 is a Y x Y diagonal matrix, and represents weights for the cost assigned 
to the respective elements of the vector Y-Yt, and 
"t" denotes transposition. 

In the following description, a first equation and a second equation of 
the equation (A-3*2) are respectively referred to as a linear equation form 
and a quadratic equation form. 

(A-3-3) Cost Evt due to twisted quantity of CMY vector (CMY vector space) 

A grid point neighboring a certain grid point "p" is denoted as pr 
(referred to as "reference grid point" hereinafter). A grid point other than 
the grid point p r neighboring the certain grid point "p" is denoted as pt 
(referred to as "transition grid point" hereinafter), and a grid point which has 
the same positional relationship with the grid point pt as that the grid point 
"p" has with the grid point p r is denoted as ptr. It is assumed that the 
respective grid points "p", p r , pt, and ptr retain CMY vectors V p , V pr , V p t, and 

Vptr. 

Fig. 12 shows positional relationship of these grid points and the 
CMY vectors retained by these grid points. In Fig. 12, if it is considered 
that a difference vector between V pr and V p is transitioned to a difference 
vector between V p tr and V pt , "a displacement of the difference vectors before 
and after the transition" is represented as a difference vector between these 
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difference vectors. In addition, if a transition distance is considered as the 
magnitude of the difference vector between V p t and V P , a "displacement of the 
difference vector before and after the transition per unit transition distance" 
is obtained by dividing "displacement of the difference vector before and after 
the transition" by the transition distance. The twisted quantity of the CMY 
vector at the grid point "p" is defined by adding the square of the magnitude 
of the "displacement of the difference vector before and after the transition 
per unit transition distance" for all of the grid points p r and p t neighboring 
the grid point "p". It should be noted that p r and p t may be the same grid 
point as long as they are neighboring "p". 

This twisted quantity of the CMY vector is represented as a cost in 
an equation (A-3-3). 



In the equation (A-3-3), 

"t" denotes a certain p t , 

T denotes the number of pt, 

"r" denotes a certain p r , 

R denotes the number of p r , and 

Dvt denotes a transition distance at "t". 

The smaller the cost E v t is, the more the twisted quantity in the CMY 
space can be reduced. 




2 



• • • (A-3-3) 
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Comparison of the equation (A-3-3) to the quadratic equation form of 
the equation (A-3-2) reveals that it is not necessary to convert the CMY 
vector to a vector in other space, and thus, M is represented as a unit vector, 
and can be omitted. The respective elements are not multiplied by the 
weights, and thus, the W2 is also a unit vector, and can be omitted. X 
corresponds to V P , and Yt corresponds to V p tr— V pr -V p t. 1/Dvt 2 is a constant 
for a certain "t", and thus, the equation (A-3-3) has the same form as the 
quadratic equation form of the equation (A-3-2). 

(A- 3-4) Cost E v due to deviation from target CMY 

It is assumed that a CMY vector Vt is an ideal (target) vector, it can 
be considered that the larger a difference between the CMY vector V P at the 
grid point "p" and the vector Vt becomes, the more the cost increases. This 
cost is denoted as E v , and is represented by an equation (A-3-4). It should 
be noted that W v is a 3 x 3 diagonal matrix, and is a weight matrix for the 
respective elements of the CMY vector. 

Ev = \Wv(\p- \t)\ 2 • • .(a-3-4) 

It can be confirmed that the equation (A-3-4) also has the same form as the 
quadratic equation form of the equation (A-3-2). 

It is not realistic that the ideal CMY vector Vt is known in advance, 
and thus, a CMY vector closer to the ideal state or a CMY vector as another 
target may be employed. On this occasion, as the CMY vector closer to the 
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ideal state, the CMY vector before smoothing is used. This is because it is 
expected that as the smoothing progresses, the CMY vector at the grid point 
comes closer to the ideal value, and the restriction on time of the smoothing 
is also considered. 

(A-3-5) Cost due to excess of CMY value from 255 

If the CMY value is normalized to 0 to 255, and the elements of the 
CMY vector V p at the grid point "p" exceed 255, the larger the excesses of 
them become, the larger the cost becomes. This cost is denoted as Ed, and is 
represented by an equation (A" 3-5). In this equation, Vl is a column vector 
having three elements which have a limit value 255, Wai is a weight column 
vector having three elements, and Wd2 is a 3 x 3 weight diagonal matrix. 
The respective weight elements of Wai and Wd2 are zero if V p — Vl is 0 or less, 
and take a positive value if V P — Vl is positive. 



The equation (A-3-5) has a linear equation form and a quadratic 
equation form, and they may be properly selected for use. It can be 
confirmed that both the linear equation form and the quadratic equation 
form of the equation (A-3-5) have the same form as those of the equation 
(A-3-2) based on the comparison of these equations. 

(A-3 6) Cost due to CMY value less than zero 

As is the case with Ed, if the CMY value is normalized to 0 to 255, and 



Ed = J 



Wj/-(V p -Vl) 
|Wd2-(Vp-V L )| 2 



• • • (A-3-5) 
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the elements of the CMY vector V p take negative values, the larger the 
excesses of the negative values become, the larger the cost becomes. This 
cost is denoted as E n , and is represented by an equation (A 3 6). In this 
equation, W n i is a weight column vector having three elements, and W n 2 is a 
3x3 weight diagonal matrix. The respective weight elements of W n i and 
Wn2 are negative if V P is negative, and are zero if V p is 0 or more. 



The equation (A 3 6) also has a linear equation form and a quadratic 
equation form, and they may be properly selected for use. It can be 
confirmed that both the linear equation form and the quadratic equation 
form of the equation (A-3-6) have the same form as those of the equation 
(A-3-2) based on the comparison of these equations. 

After the respective costs are calculated using the above (A-3-l), 
(A-3-3), (A-3-4), (A-3-5), and (A-3-6), the following smoothing processing is 
carried out. 

Smoothing processing (step S24) 

As Fig. 11 shows, then, the color conversion LUT smoothing unit 20e 
of the color conversion table producing device 20A carries out smoothing 
processing (calculation of V p which minimize the evaluation function E) (step 
S24) detailed below. 



En = < 



Wni* • Vp 
Wn2-Vp 



• • • (A-3-6) 
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(A-3-1) Outline of LUT smoothing at grid point "p" 

Smoothing of the LUT at the grid point "p" is carried out by 
minimizing the evaluation function E represented by the equation (A-3-l). 
Though an arbitrary method for minimizing the evaluation function E 
represented by the equation (A-3-l) may be used, the present embodiment 
employs the following method. 

The respective terms in the equation (A-3-l) are represented as a 
sum of the equations (A-3-3) through (A-3-6). Namely, all of the terms of the 
evaluation function E include the respective elements of the V p , and are 
represented as high as the quadratic form in terms of these elements. 
Further, the quadratic form is the square of the linear form, and is always a 
downwardly convex function. Namely, the evaluation function E takes the 
minimum value for the V p which equates function obtained by partially 
differentiating E by the respective elements of V p to a zero vector. 

As described above, all of the equations (A-3-3) through (A-3-6) take 
the same form as the equation (A-32). Hereinafter, the equation (A-3-2) is 
used to show a general form of partial differentiation of the respective terms 
of the evaluation function E by the respective elements of V p (Xin the case of 
the equation (A-3-2)). An equation (A-3-7) shows a case where the equation 
(A-3 2) is partially differentiated by the respective elements of X. 
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A = 



/ dEc BEc dEc \ 

I ,. . -,- „ ,_- . • • • — — — • • • I 



[dXi dXx dXxj 

'(Wi r -m)' 

'2(W2-M) r -W2-(M-X-Yx) 



• • • (A- 3- 7) 



where A denotes a column vector having X of elements, and the respective 
elements are obtained by partially differentiating E c by the respective 
elements X x of X. It should be noted that Y is the element number of the 
vector X, and x=l, 2, X. 

(A-3-2) Partial differentiation of evaluation function E by elements of V p 

The following section shows partially differentiated equations (A- 3 -3) 
through (A- 3-6) by the respective elements of V p as in the case of the 
equation (A-3-7). In the following equation, Avt, Av, Aa, and An denote 
column vectors having three elements respectively obtained by partially 
differentiating Evt, E v , Ed, and E n by the respective elements of C p , M p , and 



Y P of V P . 




dEvt 




• • • (A-3-8) 





• • • (A-3-9) 
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Ad = 



dEd 

ac P 



dEd 
dMp 



aY P 



Wat 

* 2Wdi 2 -(v^-Vl) 



• • • (A-3-10) 



dEn 



dEn 

aM P 




aYpJ 



• • • (A-3-11) 



[Wnt 



2Wn2 2 • Wp 



The sum of the equations (A"3-8) through (A-3-ll) is a vector 
obtained by partially differentiating the evaluation function E by the 
respective elements of V p . If this vector is a zero vector, and this equation is 
solved for V p , there can be obtained V p which minimizes E. Namely, it 
means to solve- 



for V p . It should be noted that "f is a vector obtained by partially 
differentiating E by the respective elements of V p , and is represented in a 
function form, and "0" denotes a zero vector. 

As described above, the color conversion LUT smoothing unit 20f 
obtains V p which minimizes the evaluation function E, and then, terminates 




• • • (A-3-12) 



= 0 
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the smoothing processing. 

Smoothing processing across overall LUT (step S25) 
As Fig. 5 shows, then, the color conversion LUT smoothing unit 20e 
of the color conversion table producing device 20A carries out smoothing 
processing across the entire color conversion LUT (step S25) detailed below. 

For carrying out the smoothing processing across the entire LUT, if it 
is possible to correct only V p without changing the CMY vectors retained on 
the grid points other than the grid point "p", it is possible to obtain an 
optimal V P in the method described above. However, in a more realistic case, 
it is actually necessary to correct the CMY vectors retained on the grid points 
other than the grid point "p" for smoothing across the entire color conversion 
LUT. Therefore, the smoothing across the entire color conversion LUT is 
carried out by repeating sequential correction of the CMY vectors at the 
respective grid points. 

If the correction of the CMY vector at the grid point "p" in a state "n" 
to a next state (solving the equation (A-312) for V p ) is denoted as "g\ this 
correction is generally represented as an equation (A"3-13). 

v; tJ = g("-,v p %v p n ,F p n +i •••) . .(A-3-13) 

If the correction from the state "n" to the state "n+1" is carried out at all the 
grid points, the costs E at the respective grid points are not always reduced. 
As the equation (A-3-13) shows, the CMY vectors in the state "n+1" are 
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obtained for the respective grid points based on the cost E in the state "n", 
and thus, the cost E in the state "n+1" is not considered for obtaining the 
equation (A-3-13). Namely, though, due to the purpose of reducing the cost, 
it is expected that the cost in the state "n+1" is smaller than the cost in the 
state V at most of the grid points, it does not always hold true. 

Therefore, (l) the correction is carried out at the entire grid points 
using the equation (A-3-13) (step S40), (2) the correction which increases the 
cost is not carried out (step S54), or (3) the correction by annealing which 
increases the cost by a certain degree of a small amount is permitted (step 
S56). 

Then, with reference to a flowchart shown in Fig. 11, more detailed 
description will now be given of the smoothing processing across the entire 
color conversion LUT shown in step S25 in Fig. 5. 

As Fig. 11 shows, when the smoothing processing across the entire 
color conversion LUT starts in S25, 0 (zero) is set to V in the equation 
(A-3-13) (step S30), and the CMY vectors: 




(p=0, 1, P-l) are input (step S32). Reference numeral P denotes the 
number of the grid points. 

Then it is determined whether "n<N" or not (step S34), and if "n<N" 
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holds ("Yes" in the step S34), the costs at grid point "p" in the state "n": 




(p=0, 1, P— l) are calculated (step S36), the CMY vectors in the certain 
state V at the respective grid point "p" (p=0, 1, P-l) are obtained using 
the equation (A-3-13), and a variable "Count" is set to P (step S38). 

Reference numeral N denotes how many times the smoothing is 
carried out, and indicates that the maximum value of the state V is N-l. 

If a condition "all of the grid points are not corrected" holds ("No" in 
the step S40), "p" is set to 0 (zero) (step S42), and it is determined whether 
"p<P" or not (step S44). 

Alternatively, if a condition "all of the grid points are corrected" holds 
("Yes" in the step S40), or "p<P" does not hold ("No" in the step S44), and 
"Count" is not 0 (zero) ("No" in a step S46), "n+1" is set to "n", and probability 
variable parameters for the annealing are decreased (step S48), and the 
procedure returns to the step S34. 

Alternatively, if "p<P" holds ('Yes" in the step S44), the cost for the 
grid point "p" in the state "n+1": 
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is calculated (step S50), and it is determined whether: 




or not (step S52). If the cost at the grid point "p" in the state "n+1" is equal 
to or more than the cost at the grid point "p" in the state "n" ("No" in the step 
S52), it is determined whether a condition "not corrected unless cost 
decreases" holds (step S54), and if the condition "not corrected unless cost 
decreases" does not hold ("No" in the step S54), it is determined whether a 
condition "correction with annealing is permitted" holds (step S56). 

If the condition "not corrected unless cost decreases" holds ("Yes" in 
the step S54), or the condition "correction with annealing is not permitted" 
holds ("No" in the step S56), the CMY vector at the grid point "p" in the state 

"n": 




is set to the CMY vector at the grid point "p" in the state "n+1": 




and, simultaneously, the variable (Count- 1) is set to "Count" (step S60). 
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Then, after the step S60, or if the cost at the grid point "p" in the 
state "n+1" is less than the cost at the grid point "p" in the state "n" ("Yes" in 
the step S52), or the condition "correction with annealing is permitted" holds 
("Yes" in the step S56), (p+l) is set to "p" (step S58), and the procedure 
returns to the step S44. 

Alternatively, if "n<N" does not hold in the step S34 ("No" in the step 
S34), or "Count" is 0 in the step S46 ("Yes" in the step S46), the CMY vector: 

P 

(p=0, 1, P-l) are output (step S62), and the procedure terminates. 

Then, after the smoothing processing across the entire LUT (step 
S25), the procedure returns to the step S26 in Fig. 5, the color conversion 
table is produced (step S26), and the produced color conversion table is 
stored in the color conversion LUT storing unit 20b (step S28). 

The procedure described above can produce the color conversion table 
capable of enhancing the continuity of the color conversion of the image data. 

Image processing device 

In Fig. 19, the image processing device 20B applies desired image 
processing to RGB image data, and outputs the processed image data to an 
image output device 30. 
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The image data are produced by separating a color image into 
predetermined element colors, and representing intensities in these 
respective element colors, which are chromatic colors, and may be mixed into 
achromatic colors typified by gray and black if they are mixed at 
predetermined ratios. 

In the present embodiment, a description will be given of a case 
where the image output device is a color printer using inks in six colors- C 
(cyan), M (magenta), Y (yellow), K (black), c (light cyan), and m (light 
magenta), and reproducing colors based on the RGB data. 

The image processing device 20B is comprised of a first color 
converting unit 20h which converts the RGB image data to CMY image data, 
a color conversion LUT storing unit 20b which stores at least the color 
conversion table produced by the color conversion table producing device 20A, 
a second color converting unit 20a which reads a color conversion table 
(LUT) selected by a color conversion LUT selecting unit 20c from the color 
conversion LUT storing unit 20b, refers to the read color conversion LUT 
thereby converting the CMY image data to C'M'T image data, and a third 
color converting unit 20g which converts the C'MT image data to CMYKcm 
image data. 

A description will now be given of an operation of the image 
processing device 20B with reference to Fig. 4. 

As Fig. 4 shows, if the user instructs the image output start (step 70), 
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and a predetermined color conversion LUT is selected through the color 
conversion LUT selecting unit 20c ("Yes" in a step 72), the predetermined 
color conversion LUT is read from the color conversion LUT storing unit 20b, 
and read into the RAM (step 74). Then, the color conversion LUT is built 
into the second color converting unit 20a (step 76), the three-dimensional 
color conversion LUT is referred to to carry out image processing using 
interpolation, and image output processing is carried out (step 78). 

According to the image processing device 20B according to the 
present embodiment, if in the step 72 is selected a color conversion table 
which is produced by the color conversion table producing device 20A, and 
can enhance the continuity of the color conversion of the image data, the 
color conversion is carried out using the color conversion table, and thus, the 
tone jump is prevented after the color conversion. 

(B) Second embodiment (chroma maintenance processing) 

If simple smoothing is applied to the table to solve the discontinuity 
in the lattice, the chroma may decrease across the entire table. A 
description will now be given of a chroma maintenance processing for 
producing a color conversion table which restrains the color twist and the 
tone jump as much as possible while maintaining the chroma. 

The chroma maintenance processing is carried out in "(A- 1-6) Cost E v 
due to deviation from target virtual CMY". As described in (A - 1-6), it is 
considered that the virtual CMY vector V P at the grid point "p" takes the 
virtual CMY vector Vt as an ideal vector, this cost E v is denoted by the 
equation (A- 1-6) using the conversion matrix K. 
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It should be noted that W v is a 3 x 3 diagonal matrix, and is a weight 
matrix for the respective elements of the virtual CMY vector. It can be 
confirmed that the equation (A- 1-6) also has the same form as the second 
equation of the equation (A- 1-2). 

It is not realistic that an ideal virtual CMY vector Vt is known in 
advance as in the case of It, and thus, a virtual CMY vector closer to an ideal 
state or a virtual CMY vector as another target may be employed. On this 
occasion, as the virtual CMY vector closer to the ideal state, the virtual CMY 
vector before smoothing is used. This is because it is expected that as the 
smoothing progresses, the virtual CMY vector comes closer to the smoother 
ideal virtual CMY vector, and the restriction on time of the smoothing is also 
considered. 

However, the smoothing may decrease the chroma represented by the 
color data at grid points. If the chroma decreases, vividness of an image 
decreases, and thus, the colors are not reproduced faithfully. Therefore, it is 
desirable that the chroma of the color data before and the after the 
smoothing is maintained approximately constant. 

A description will now be given of the chroma maintenance 
processing with reference to Fig. 13. 

Fig. 13 (A) shows the virtual CMY space. The virtual CMY space is 
represented by a C axis, an M axis, and a Y axis. A lightness axis 100 is a 
line satisfying C=M=Y in the virtual CMY space, and color data specified by 
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a color coordinate on the lightness axis 100 represents gray. The lightness 
changes along the lightness axis 100. It should be noted that the chroma 
changes along a line orthogonal to the lightness axis 100, namely a chroma 
axis 110, and the hue changes in a hue direction 120 about the lightness axis 
100 on a plane perpendicular to the lightness axis 100. 

Fig. 13(B) shows a CM plane in the virtual CMY space shown in Fig. 
13(A). The chroma maintenance processing is described on the CM plane 
for the sake of simple description. In Fig. 13(B), the horizontal axis and the 
vertical axis represent the C axis and the M axis respectively. It should be 
noted that the lightness axis 100 in the Fig. 13(A) is projected on the CM 
plane. 

A color coordinate of the grid point "p" is represented as (C p , M p , Y p ) 
in the virtual CMY space. It is assumed that a target point of the 
smoothing of the grid point "p" in the virtual CMY is a point T, and the color 
coordinate of the point T is represented as (Ct, Mt, Yt). 

The respective minimum distances from the grid point "p" and the 
point "T" to the lightness axis 100 are denoted as Lp and Lt. If the shortest 
distance from the respective grid point to the lightness axis 100 corresponds 
to the chroma represented by the color data at that grid point, the chroma 
values of the grid point "p" and the point "T" respectively corresponds to the 
Lp and Lt. 

In Fig. 13(B), the positional relationship between the grid point "p" 
and the point T is "L/r<Lp", the chroma at the point T is lower than the 
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chroma at the grid point "p". In this case, to avoid the decrease of the 
chroma, a position T (color coordinate (Ct\ Mt, YtO) which satisfies "Lt >= Lp" 
is set as a target point in the virtual CMY in place of the point T. On this 
occasion, the chroma at the point T is the same as that at the grid point "p". 
Further, the lightness and the hue at the point T are equal to those at the 
point T. 

In this way, if the chroma represented by the color data decreases due 
to the smoothing, the target color coordinate in the virtual CMY is changed 
from the color coordinate at the point T to the color coordinate at the point T\ 
thereby maintaining the chroma constant without changing the lightness 
and the hue of the color data. 

If the target color coordinate is changed from the point T to the point 
T in the virtual CMY, the equation (A- 1-6) is changed as-* 

E v = \ Wv(K-Ip- Vt')| 2 • • .(B-7) 

where a virtual CMY vector W is a vector held at the point T\ It should be 
noted that the point T satisfies "Lr'^Lp". 

Vector components of a virtual CMY vector K I p (=V P ) at the grid 
point "p" and the vector components of the target virtual CMY vector W at 
the point T are respectively represented as- 
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V P = 



(C t \ 
Mp 
Y 9/ 



(B-8) 



Vt' = 



/Ct'\ 

Mt' 

Ft' 
\ 1 J 



• • • 



(B-9) 



The following equation is obtained by assigning the equations (B-8) and (B-9) 
to the equation (B-7). 
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(B-10) 



In this way, if the target point T in the virtual CMY space satisfies 
"Lt<Lp"> the equation (B-10) is used for the point T satisfying "Lt-Lp", 
thereby maintaining the chroma of the color data constant before and after 
the smoothing. Then, the processing from (A- 1*7) is carried out. 
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A description will now be given of a variation to the chroma 
maintenance processing. 

First variation 

In a first variation, a chroma ratio is considered where the chroma 
ratio is specified by a ratio of the chroma of color data to the maximum 
chroma determined by the lightness and the hue of the color data. Namely, 
in the smoothing according to the present variation, the chroma ratio of color 
data before the smoothing and the chroma ratio of color data after the 
smoothing are approximately the same. 

A description will now be given of calculation of E v according to the 
present variation with reference to Fig. 14. Fig. 14 shows the CM plane and 
the lightness axis 100 projected on the CM plane. It is assumed that the 
color coordinate of the grid point "p" in the virtual CMY is (Cp, M p , Y p ), and 
the color coordinate of the point T is (Ct, Mt, Yt). 

The chroma at the grid point "p" is Lp, and the chroma at the point T 
is Lt. The maximum chroma determined by the lightness and the hue at 
the grid point "p" is denoted as Lpmax, the maximum chroma determined by 
the lightness and the hue at the point T is denoted as Lowx- 

In the first variation, if the chroma Lt at the point T satisfies 
'tLT/LTmax)<(lV^>max)", it is considered that the chroma decreases. In this 
case, to avoid the decrease of the chroma, a position T (color coordinate (Ct\ 
Mt, Yt')) which satisfies 'tLT ? /LTmax)=(Lp/Lpmax)" is set as a target point in the 
virtual CMY in place of the point T. Further, the lightness and the hue at 
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the point T are respectively equal to those at the point T. 

In this way, if the chroma ratio of the color data decreases due to the 
smoothing, the target coordinate in the virtual CMY is changed from the 
color coordinate at the point T to the color coordinate at the point T, thereby 
maintaining the chroma ratio constant without changing the lightness and 
the hue of the color data. 

In this case, the cost E v is calculated using the equation (B IO) 
described in the present embodiment. It should be noted that the virtual 
CMY vector W is a vector which satisfies 'tW/Iyrmax)<(l^/Lpmax)" in the 
equation (BIO). In this way, if the target point T in the virtual CMY space 
satisfies "(LT/LTmax) < (Lp/Lpmax) , ^ the equation (B-10) is used for the point T' 
satisfying "(l^'/LTmax)=(Lp/Lpmax)'^ thereby maintaining the chroma ratio of 
the color data constant before and after the smoothing. 

Second variation 

A description will now be given of a second variation of how to 
calculate the cost E v due to a deviation from the target virtual CMY. 
Though the second variation is the same as the first variation in maintaining 
the chroma ratio constant, the same processing as the first variation is 
carried out only if the color data at a grid point before the smoothing 
presents the maximum chroma value in the present variation. 

As a result, if the color data at a grid point presents the maximum 
chroma value before the smoothing, the color data after the smoothing 
maintains the maximum chroma value. 
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Third variation 

A description will now be given of a third variation of how to calculate 
the cost E v due to a deviation from the target virtual CMY. Though the 
third variation is the same as the first and second variations in maintaining 
the chroma ratio constant, the chroma ratio of the color data is maintained 
approximately constant before and after the smoothing if the color data at a 
grid point before the smoothing does not have at least one color of CMY 
constituting the color data in the third variation. 

A description will now be given of calculation of E v according to the 
third variation with reference to Fig. 15. Fig. 15 shows the CM plane and 
the lightness axis 100 projected on the CM plane as in the case of Fig. 14. 
The color coordinate of a grid point "p" in Fig. 15 is (C P , 0, Y p ), and does not 
include M of the element colors of CMY. Thus, if a target point T in the 
virtual CMY (color coordinate (Ct, Mt, Yt) (Mt^O)) satisfies 
"(LT , /LTmax)<(Lp/L P max)", the chroma decreases, and also the element color M 
which is not contained in the color data before the smoothing is contained. 
However, according to the third example, a point T which satisfies 
"(LT/LTmax)=(Lp/Lfpmax)", namely the point T ? at a color coordinate (Ct , 0, YrO, 
is employed as a target coordinate in the virtual CMY in place of the 
coordinate of the point T. Therefore, color data after the smoothing can be 
caused not to include an element color which is not included in the color data 
before the smoothing, and simultaneously, the chroma of the color data 
before and after the smoothing can be maintained constant. 

(C) Third embodiment (program file producing device) 
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Fig. 16 shows a function block diagram of a profile producing device 
20 according to an embodiment of the present invention. A specific 
hardware constitution example of the profile producing device 20 is the same 
as the schematic block diagram according to the first embodiment in Fig. 2, 
and thus, a description will be omitted. 

It should be noted that "profile" described in the claims corresponds 
to "ICC profile" according to the present embodiment. The ICC profile is a 
color conversion table compliant with specifications of the ICC (International 
Color Consortium). A "color conversion table" implies a table for converting 
device values (such as RGB values) to ink quantities (such as CMYKcm), and 
the device value is dependent on a color reproduction characteristic of an 
image output device which is a separation characteristic, and is not applied 
with specific color correction as in the case of a color correction table. In a 
description below, the color conversion table may be simply referred to as 
"color conversion LUT" for the sake of simplicity of the description. 

"Smoothed table producing means" described in the claims 
corresponds to a cost calculating unit 20g, a color conversion LUT smoothing 
unit 20f, and a color conversion LUT producing unit 20e, and "color chart 
producing means" corresponds to a color converting unit 20a. 

Constitution of profile producing device 

Fig. 16 is the function block diagram of the profile producing device 
20 according to the embodiment of the present invention. The color 
converting unit 20a of the profile producing device 20 converts input RGB 
image data to CMYKcm image data, and causes a printer as an image output 
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device 30 to print a color chart 50 based on the converted CMYKcm image 
data. On the other hand, an ICC profile producing unit 20i of the profile 
producing device 20 uses colorimetry data of the printed color chart to 
produce an ICC profile. 

The image data are produced by separating a color image into 
predetermined element colors, and representing intensities in these 
respective element colors, which are chromatic colors, and may be mixed into 
achromatic colors typified by gray and black if they are mixed at 
predetermined ratios. 

The color chart represents output results of the image output device 
30 arranged on predetermined areas when the respective RGB values of an 
image input signal shown in Fig. 16 are independently changed in the tone 
from 0 to 255 at a predetermined tone step. It is assumed that the 
respective RGB values of the image input signal and the corresponding 
arranged locations of the output results are known in advance. 

Though, in the present embodiment, a description is given of a case 
where the profile producing device 20 produces an ICC profile used for color 
conversion from RGB to Lab, an ICC profile used for other color conversion 
can be produced in the same manner. Namely, there can be produced an 
ICC profile used for color conversion from device values (such as RGB values, 
CMY values, and CMYK values) dependent on the color reproduction 
characteristic of the image output device to colorimetry values (Lab values, 
Luv values, XYZ values, and CIE CAM97S) indicating appearance of a color. 
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The profile producing device 20 shown in Fig. 16 is comprised of the 
cost calculating unit 20g for calculating a function (referred to as "evaluation 
function" hereinafter) E for evaluating a level of smoothing of data at 
respective lattice points (grid points) after the color conversion, the color 
conversion LUT smoothing unit 20f for carrying out smoothing processing 
using costs calculated by the cost calculating unit 20g, the color conversion 
LUT producing unit 20e for producing a color conversion LUT capable of 
enhancing continuity of color data when CMY data are converted to 
CMYKcm data using the smoothed data at the respective grid points, the 
color converting unit 20a for converting the RGB data to the CMYKcm data 
using the color conversion LUT produced by the color conversion LUT 
producing unit 20e, and the ICC profile producing unit 20i for producing an 
ICC profile using values color-metered by a colorimetry unit 20h. 

Profile producing processing control program 

A profile producing processing control program according to the 
present invention is usually recorded on a recording medium such as a floppy 
disk or a CD-ROM in a form readable by the computer 12, and circulated. 
The program is read by a media reader (such as a CD-ROM drive 13c and a 
floppy disk drive 13a), and then, is installed on a hard disk 13b. There is 
such a constitution that a CPU then properly reads a desired program from 
the hard disk 13b, and carries out desired processing. It should be noted 
that the profile producing processing control program according to the 
present invention itself constitutes a part of the invention of the present 
application. 

A description will now be given of the profile producing processing 
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control program executed by the profile producing device 20 shown in Fig. 16 
with reference to Fig. 17 and Fig. 18. 

Fig. 17 shows a flowchart showing an operation of the profile 
producing device 20 when the color conversion LUT is produced. 

As Fig. 17 shows, first, the cost calculating unit 20g carries out 
calculation processing for the respective costs of the evaluation function E 
which is a function for evaluating the level of smoothing of data at the 
respective grid points after the color conversion (step S22). The calculation 
processing for the respective costs is similar to that of the first example of 
the first embodiment, and thus, a description will be omitted. 

Then the color conversion LUT smoothing unit 20f carries out the 
smoothing processing at the respective grid points (step S24). The 
smoothing processing is also similar to that of the first example of the first 
embodiment, and thus, a description will be omitted. 

Then, the color conversion LUT smoothing unit 20f carries out the 
smoothing processing across the entire color conversion LUT (step S25). 
The smoothing processing across the entire color conversion LUT is also 
similar to that of the first example of the first embodiment, and thus, a 
description will be omitted. 

Then, after the smoothing processing across the entire LUT (step 
S25), the procedure returns to the step S26 in Fig. 17, and the color 
conversion LUT producing unit 20e produces the color conversion LUT (step 
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S26). 

The procedure described above can produce the color conversion LUT 
capable of enhancing continuity of the color conversion of the image data by 
correcting jumps of the separation characteristic. 

Fig. 18 is a flowchart showing an operation of the profile producing 
device 20 when the ICC profile is produced using the color conversion LUT 
produced by the color conversion LUT producing processing described in Fig. 
17. 

First, RGB image data for producing the color chart 50 is transmitted 
to the color converting unit 20a and the ICC profile producing unit 20i (step 
S80). Then, the color converting unit 20a refers to the color conversion LUT 
produced by the color conversion LUT producing unit 20e so as to carry out 
the color conversion from the RGB image data to the CMYKcm image data 
using interpolation, creates the color chart 50 from the CMYKcm image data 
after the color conversion, and causes the printer as the image output device 
30 to print the produced color chart 50 (step S82). 

In this way, the profile producing device 20 according to the present 
embodiment uses the color conversion LUT to produce the color chart 50, 
where the color conversion LUT is produced using the evaluation function E, 
namely the color conversion LUT can enhance the continuity of the color 
conversion of the image data by correcting the jumps in the separation 
characteristic. 
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Then, the colorimetry unit 20h measures colors at the respective 
lattice points in the printed color chart 50 (step S84). The colorimetry unit 
20h color-meters the respective colors as Lab data in the Lab space. 

Then, the profile producing unit 20i corresponds the RGB data as the 
image input data in respective predetermined areas on the color chart 
obtained in the step S80 and the Lab data as the color-metered values by the 
colorimetry unit 20h in the respective predetermined areas to each other, 
thereby producing the ICC profile (step S86). 

In this way, the profile producing device 20 according to the present 
embodiment uses the color chart 50 to produce the ICC profile used for 
converting RGB data to Lab data where the color chart 50 is produced using 
the color conversion LUT capable of enhancing the continuity of the color 
conversion of image data by correcting the jumps in the separation 
characteristic. In this way, it is possible to prevent tone jumps in an image 
after the color conversion by carrying out the color conversion using the ICC 
profile produced by the profile producing device 20. 

Though the above description for the present invention is given of the 
one embodiment, the technical scope of the present invention is not limited 
to the above description, and the above embodiment may be modified or 
improved. 
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